-- Logs begin at Wed 2022-10-12 11:48:03 UTC, end at Wed 2022-10-12 12:59:14 UTC. -- Oct 12 12:29:20.387322 dv-cinder-812685-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 12:29:20.396171 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 12:29:20 2022] *** Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: nodename: dv-cinder-812685-16-iscsi Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: machine: x86_64 Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: clock source: unix Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: pcre jit disabled Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: detected number of CPU cores: 4 Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: current working directory: / Oct 12 12:29:20.398094 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: detected binary path: /usr/bin/uwsgi-core Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: your processes number limit is 47680 Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: your memory page size is 4096 bytes Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: detected max file descriptor number: 2048 Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: lock engine: pthread robust mutexes Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: thunder lock: enabled Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 12:29:20.398882 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 12:29:20.437738 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: Python main interpreter initialized at 0x56451fb2f9c0 Oct 12 12:29:20.437738 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: python threads support enabled Oct 12 12:29:20.437738 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: your server socket listen backlog is limited to 100 connections Oct 12 12:29:20.437738 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: your mercy for graceful operations on workers is 90 seconds Oct 12 12:29:20.438078 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 12:29:20.438170 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: *** Operational MODE: preforking *** Oct 12 12:29:20.438418 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: *** uWSGI is running in multiple interpreter mode *** Oct 12 12:29:20.438418 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: spawned uWSGI master process (pid: 104193) Oct 12 12:29:20.438599 dv-cinder-812685-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 12:29:20.439251 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: spawned uWSGI worker 1 (pid: 104194, cores: 1) Oct 12 12:29:20.439444 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: spawned uWSGI worker 2 (pid: 104195, cores: 1) Oct 12 12:29:20.439604 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 12:29:21.098319 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 12:29:21.099254 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 12:29:22.171881 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:29:22.171881 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: from cryptography.utils import int_from_bytes Oct 12 12:29:22.172444 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:29:22.172444 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: from cryptography.utils import int_from_bytes Oct 12 12:29:22.172559 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:29:22.172559 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: from cryptography.utils import int_from_bytes Oct 12 12:29:22.172958 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:29:22.172958 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: from cryptography.utils import int_from_bytes Oct 12 12:29:24.654563 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:29:24.655118 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:29:24.655215 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:29:24.655553 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:29:24.655662 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:29:24.655662 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:29:24.655804 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:29:24.655920 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:29:24.656166 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:29:24.656280 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.656412 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:29:24.656605 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.656792 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.656921 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657121 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657220 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657439 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657526 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657756 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.657849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658111 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658201 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658423 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658509 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658744 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.658829 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659004 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659100 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659310 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659397 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659611 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659714 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-16-iscsi {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.659920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660013 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660217 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660303 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-16-iscsi {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660521 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660618 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660831 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.660923 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661126 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661214 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661437 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661529 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661732 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.661826 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662075 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662250 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662368 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662688 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662867 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.662994 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663177 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663306 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663479 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663594 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663787 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.663916 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664119 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664226 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664429 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664523 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664734 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.664834 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665076 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665217 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665382 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665477 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665696 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.665805 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-16-iscsi {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666032 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666172 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666383 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666548 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-16-iscsi {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666691 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.666835 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667017 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667149 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667330 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667443 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667757 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.667970 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668059 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668285 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668368 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668587 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668680 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668904 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.668999 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669215 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669310 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669530 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669633 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669843 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.669971 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670166 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670268 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670472 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670560 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670770 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.670858 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671078 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671165 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671372 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671475 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671669 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671764 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.671915 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672003 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672215 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672315 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672489 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672575 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672795 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.672884 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673110 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673204 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673359 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673445 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673604 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673733 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.673916 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674072 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674241 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674327 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674544 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674642 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.674937 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675154 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675245 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675456 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675624 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675761 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.675848 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676079 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676212 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676363 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676458 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676664 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676760 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.676969 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677065 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677273 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677369 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677670 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.677888 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678001 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678226 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678315 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678535 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678848 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.678932 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679153 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679243 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679476 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679562 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679788 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.679891 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.680091 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.680183 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.680403 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.680980 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681234 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681322 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681538 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681642 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681841 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.681970 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682169 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682272 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682472 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682562 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682779 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.682870 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683082 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683180 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683328 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683440 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683622 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683710 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.683922 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684058 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684216 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684304 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684519 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684604 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684822 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.684918 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685122 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685209 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685414 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685500 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685717 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.685812 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686034 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686137 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686340 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686432 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686641 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686734 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.686940 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687025 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687239 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687324 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687536 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687623 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687837 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.687929 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688134 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688226 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688432 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688527 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688734 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.688827 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689036 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689122 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689334 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689420 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689633 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689729 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.689981 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690074 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690254 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690343 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690555 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690649 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690853 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.690939 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691152 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691240 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691453 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691544 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691748 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.691833 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692044 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692135 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692352 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692438 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692652 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692747 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.692949 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693042 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693259 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693354 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693553 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693648 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693853 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.693960 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694171 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694256 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694474 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694573 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694770 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.694857 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695068 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695156 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695363 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695458 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695660 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695746 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.695956 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.696041 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.696818 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.696931 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697124 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697242 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697417 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697510 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697724 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.697815 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698043 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698136 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698353 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698442 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698655 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698746 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.698955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699054 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699257 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699353 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699556 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699671 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.699885 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:29:24.699976 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700203 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700295 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700507 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700598 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700830 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.700922 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701151 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701257 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701459 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701555 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701763 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.701850 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702095 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702198 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702412 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702498 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702713 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.702798 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703017 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703179 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703322 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703409 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703627 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703721 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.703934 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704044 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704251 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704385 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704557 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704652 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704864 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.704959 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705176 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705270 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705480 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705567 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705794 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.705892 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.706127 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.706231 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.706450 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.706775 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707096 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707249 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707397 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707576 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707740 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.707920 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.708079 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.708267 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.708389 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.708579 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.708711 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709031 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709233 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709358 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709470 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709626 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709744 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.709957 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710078 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710283 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710489 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710629 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.710958 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711165 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711253 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711479 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711575 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711817 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.711917 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712128 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712214 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712436 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712523 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712746 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.712845 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713054 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713141 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713358 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713443 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713664 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713757 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.713988 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714091 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714318 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714442 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714625 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714713 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.714936 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715022 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715245 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715341 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715554 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715641 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715863 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.715947 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716169 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716257 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716556 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716772 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.716869 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717068 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717153 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717368 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717463 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717665 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717752 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.717990 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718094 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718290 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718378 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718601 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718695 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.718921 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719022 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719224 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719361 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719533 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719620 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719836 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.719931 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720140 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720227 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720439 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720533 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720739 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.720838 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721036 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721123 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721335 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721419 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721638 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721725 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.721955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722047 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722258 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722343 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722563 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722661 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722862 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.722952 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723162 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723247 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723468 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723555 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723769 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.723863 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724075 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724162 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724377 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724679 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724765 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.724982 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725081 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725284 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725379 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725591 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725676 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.725901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726095 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726241 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726332 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726546 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726631 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726866 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.726965 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727171 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727257 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727514 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727600 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727813 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.727908 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728121 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728209 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728419 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728505 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728719 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.728807 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729016 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729103 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729314 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729472 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729610 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.729697 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730203 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730321 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730502 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730599 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730799 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.730894 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731093 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731187 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731390 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731486 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731685 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731780 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.731983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732076 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732334 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732445 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732575 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732685 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732868 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.732964 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733164 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733264 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733497 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733585 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733793 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.733880 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734151 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734252 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734599 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734779 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.734868 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735089 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735186 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735395 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735483 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735705 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.735792 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736006 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736093 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736312 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736405 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736632 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736721 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.736940 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737028 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737255 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737341 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737566 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737654 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.737878 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738023 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738208 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738293 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738520 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738605 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738821 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.738916 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739133 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739218 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739432 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739518 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739741 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.739830 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740071 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740157 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740385 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740483 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740694 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.740781 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741006 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741092 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741311 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741404 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741617 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741710 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.741918 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742022 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742246 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742350 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742553 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742645 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742857 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.742943 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.743695 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.743792 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744000 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744087 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744312 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744397 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744614 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744739 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.744926 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745011 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745225 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745319 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745536 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745623 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745833 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.745973 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746171 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746260 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746487 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746573 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746799 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.746895 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747099 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747185 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747407 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747495 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747712 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.747797 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748013 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748098 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748315 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748402 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748617 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748708 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.748915 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749014 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749214 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749303 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749518 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749606 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749824 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.749927 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750147 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750234 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750450 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750535 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750750 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.750846 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751049 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751142 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751349 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751435 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751648 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751742 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.751945 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752033 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752252 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752566 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752660 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752870 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.752956 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753176 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753263 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753478 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753567 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753772 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.753859 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754097 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754187 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754404 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754491 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754704 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.754788 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755002 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755089 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755300 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755390 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755595 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755683 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.755920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756014 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756227 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756313 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756525 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756613 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756838 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.756932 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757151 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757236 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757579 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757682 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757762 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.757849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.758075 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.758165 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.758384 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.758472 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759229 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759548 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759642 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759853 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.759941 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760162 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760253 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760470 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760564 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760781 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.760869 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761092 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761181 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761402 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761488 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761706 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.761791 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762034 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762137 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762341 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762435 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762641 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762737 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.762949 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.763204 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.763299 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.763539 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.763804 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.763899 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764132 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764220 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764444 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764531 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764756 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.764894 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765103 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765201 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765416 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765513 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765729 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.765815 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766062 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766152 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766378 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766467 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766675 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766760 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.766976 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767069 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767275 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767360 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767575 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767676 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767876 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.767983 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768173 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768260 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768470 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768557 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768768 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.768862 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769072 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769158 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769366 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769451 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769667 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769775 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.769982 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770075 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770285 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770375 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770592 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770681 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770890 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.770977 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771199 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771286 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771500 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771588 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771799 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.771884 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772098 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772185 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772395 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772482 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772693 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772787 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.772990 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773077 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773325 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773415 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773626 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773713 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.773974 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774076 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774310 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774616 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774703 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.774938 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775078 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775235 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775322 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775533 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775626 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775835 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.775931 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776136 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776226 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776432 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776520 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776729 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.776816 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777070 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777166 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777322 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777416 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777625 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777752 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.777944 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778051 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778254 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778361 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778555 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778643 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778852 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.778937 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779150 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779236 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779446 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779537 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779744 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.779831 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780046 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780149 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780338 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780426 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780635 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780723 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.780931 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781044 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781232 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781325 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781527 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781614 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781830 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.781926 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782154 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782241 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782457 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782543 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782753 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.782852 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783049 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783136 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783343 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783430 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783641 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783734 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.783941 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784027 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784237 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784325 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784545 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784632 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784846 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.784934 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785141 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785226 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785438 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785737 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.785823 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786057 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786147 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786356 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786445 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786659 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786745 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.786967 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787052 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787273 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787359 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787570 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787658 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787868 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.787979 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788162 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788258 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788459 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788545 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788756 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.788849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789055 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789143 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789346 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789439 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789643 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789738 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.789983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790071 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790281 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790366 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790577 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790681 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790885 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.790978 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791184 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791270 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791480 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791578 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791777 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.791864 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792072 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792158 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792406 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792495 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792704 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.792800 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793027 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793113 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793339 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793426 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793645 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793739 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.793973 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794090 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794280 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794676 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794773 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.794923 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795021 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795221 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795358 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795529 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795617 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795833 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.795932 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796144 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796231 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796441 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796531 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796737 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.796838 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797051 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797145 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797357 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797662 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797759 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.797995 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798098 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798313 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798403 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798620 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798719 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.798913 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799000 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799217 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799306 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799525 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799613 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799822 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.799909 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800124 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800425 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800514 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800730 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.800828 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801034 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801119 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801339 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801425 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801643 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801731 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.801981 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802074 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802266 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802354 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802563 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802649 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802861 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.802956 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803156 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803244 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803455 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803539 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803760 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.803860 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804055 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804142 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804355 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804441 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804652 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804747 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.804957 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.805066 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.805254 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.805376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806206 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806300 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806519 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806605 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806827 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.806913 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807130 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807280 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807439 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807527 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807747 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.807833 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808045 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808141 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808355 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808465 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808654 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.808778 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809063 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809152 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809372 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809458 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809670 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809754 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.809988 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810081 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810286 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810371 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810582 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810681 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810887 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.810982 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811184 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811270 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811483 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811582 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811777 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.811864 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812073 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812161 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812385 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812480 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812681 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812797 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.812993 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.813104 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.813396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.813492 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.813701 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.813789 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814026 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814115 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814412 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814501 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814726 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.814831 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815030 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815119 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815347 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815433 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815648 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815734 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.815957 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816045 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816251 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816336 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816563 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816651 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816866 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.816952 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817173 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817260 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817482 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817571 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817784 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.817877 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818114 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818202 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818413 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818512 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818726 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.818815 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819041 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819139 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819345 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819431 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.819754 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820050 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820144 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820365 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820671 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820767 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.820972 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.821073 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.821816 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.821911 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822143 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822229 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822442 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822532 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822743 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.822829 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823042 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823128 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823343 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823433 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823653 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823748 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.823950 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824039 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824259 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824355 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824558 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824645 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824860 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.824948 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825155 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825257 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825453 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825556 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825772 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.825872 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826123 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826212 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826444 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826543 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826763 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.826864 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827065 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827153 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827377 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827463 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827676 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827772 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.827977 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828063 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828277 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828376 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828571 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828680 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828868 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.828965 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829164 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829252 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829497 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829592 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829792 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.829879 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830136 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830228 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830454 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830542 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830774 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.830860 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831080 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831169 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831395 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831483 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831702 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.831790 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832013 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832106 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832318 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832407 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832621 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832715 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.832921 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833018 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833224 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833328 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833522 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833608 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833820 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.833917 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834141 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834231 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834438 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834736 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.834830 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835036 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835123 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835335 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835430 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835635 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835731 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.835933 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836021 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836247 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836341 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836550 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836637 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836875 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.836964 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837176 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837263 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837474 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837570 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837811 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.837899 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838136 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838225 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838471 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838572 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838781 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.838873 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839101 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839194 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839407 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839495 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839725 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.839817 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840038 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840132 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840352 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840438 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840663 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840749 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.840976 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841071 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841288 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841594 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841680 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.841903 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842069 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842230 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842320 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842542 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842637 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.842852 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843056 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843165 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843386 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843671 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843766 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.843994 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844083 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844301 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844395 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844607 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844696 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.844911 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845007 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845219 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845305 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845526 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845614 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845833 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.845923 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846159 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846246 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846468 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846569 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846774 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.846863 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847096 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847181 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847412 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847607 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847734 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.847840 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848060 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848148 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848371 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848521 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848680 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848811 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.848986 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849075 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849293 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849389 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849625 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849719 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.849961 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850064 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850269 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850359 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850578 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850664 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850884 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.850979 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851191 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851280 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851498 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851806 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.851907 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852112 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852199 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852441 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852531 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852746 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.852843 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853048 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853138 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853354 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853441 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853661 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853750 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.853999 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.854090 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.854312 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.854398 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.854627 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.854723 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.855203 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.855296 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.855510 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.855712 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.855848 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856024 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856313 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856408 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856629 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856730 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.856957 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857045 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857270 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857356 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857585 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857682 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.857894 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858025 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858222 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858309 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858531 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858635 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858839 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.858934 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859137 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859224 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859435 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859530 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859737 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.859823 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860033 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860122 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860334 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860421 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860643 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860730 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.860941 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.861036 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.861255 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.861462 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.861558 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.861802 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862098 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862192 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862436 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862748 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.862837 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863060 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863145 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863365 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863454 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863674 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863762 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.863974 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864070 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864272 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864364 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864672 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864878 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.864974 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865175 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865263 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865475 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865563 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865771 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.865865 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866093 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866183 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866391 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866477 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866698 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866794 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.866995 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867080 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867296 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867382 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867594 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867684 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.867894 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.868487 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.868713 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.868802 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869009 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869097 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869308 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869397 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869607 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869710 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.869900 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870010 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870220 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870306 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870516 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870602 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870812 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.870902 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871115 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871201 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871412 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871507 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871712 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.871800 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872011 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872099 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872320 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872419 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872634 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872722 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.872949 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873036 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873248 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873344 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873545 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873632 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873855 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.873989 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874180 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874281 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874490 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874587 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874794 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.874883 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875107 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875218 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875416 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875506 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875723 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.875816 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876067 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876256 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876374 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876895 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.876985 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877224 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877319 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877535 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877621 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877839 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.877927 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878168 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878258 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878470 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878560 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878768 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.878870 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879068 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879163 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879383 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879472 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879686 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879781 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.879991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880078 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880296 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880388 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880597 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880693 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880898 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.880985 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881198 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881284 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881499 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881586 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881797 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.881883 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882122 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882210 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882427 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882516 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882728 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.882823 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.883030 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.883119 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.883333 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.883422 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.883684 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.884274 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.884497 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.884595 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.884833 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.884921 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885150 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885238 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885467 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885564 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885777 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.885862 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886107 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886242 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886411 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886512 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886713 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.886808 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887108 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887325 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887424 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887639 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887727 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.887939 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.888026 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.888257 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.888557 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.888643 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.888896 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.889210 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.889297 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.889529 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.889617 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.889840 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890002 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890184 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890275 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890592 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890816 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.890904 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891136 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891232 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891445 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891534 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891765 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.891852 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892072 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892170 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892398 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892486 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892717 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.892803 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893023 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893166 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893326 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893414 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893627 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893715 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.893926 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894032 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894247 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894335 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894550 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894637 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894851 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.894941 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895149 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895237 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895448 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895533 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895746 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.895834 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896045 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896133 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896342 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896481 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896638 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896725 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.896933 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897027 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897232 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897377 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897536 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897625 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897829 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.897916 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898152 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898255 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898448 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898535 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898744 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.898832 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899038 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899138 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899359 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899451 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899658 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899747 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.899955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900049 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900255 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900344 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900553 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900641 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900854 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.900950 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901152 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901248 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901476 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901571 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901797 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.901884 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902129 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902218 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902446 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902532 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902752 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.902841 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903067 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903163 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903369 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903682 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903769 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.903987 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904083 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904292 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904394 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904638 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904733 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.904907 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905002 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905210 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905309 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905515 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905602 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905819 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.905906 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906147 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906307 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906441 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906568 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906740 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.906836 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907068 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907157 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907385 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907471 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907683 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.907769 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908000 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908098 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908308 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908395 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908619 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908714 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.908927 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909014 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909233 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909329 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909544 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909639 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909848 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.909956 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910177 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910263 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910482 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910585 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910787 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.910876 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911093 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911179 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911401 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911497 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911703 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.911790 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912008 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912095 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912317 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912406 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912626 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912713 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.912930 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913016 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913247 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913342 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913551 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913647 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913871 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.913980 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914217 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914314 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914552 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914638 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914882 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.914972 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915200 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915294 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915510 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915599 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915811 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.915908 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.916052 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104194) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:29:24.916142 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.916405 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:29:24.916644 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=104195) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:29:25.070115 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO dbcounter [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Registered counter for database nova_api Oct 12 12:29:25.070774 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO dbcounter [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Registered counter for database nova_api Oct 12 12:29:25.091313 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_db.sqlalchemy.engines [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.094821 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_db.sqlalchemy.engines [None req-65a3e316-9030-4746-948a-a141e327e787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.097769 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writer thread running {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.101384 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writer thread running {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.153887 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.context [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad657cf-e300-4750-943b-1f19054f5990(cell1) {{(pid=104194) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 12:29:25.157769 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:29:25.158217 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:29:25.158315 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.context [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad657cf-e300-4750-943b-1f19054f5990(cell1) {{(pid=104195) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 12:29:25.159732 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:29:25.160455 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:29:25.160893 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:29:25.162115 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:29:25.162587 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:29:25.162894 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:29:25.164125 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:29:25.165338 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:29:25.165455 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO dbcounter [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Registered counter for database nova_cell0 Oct 12 12:29:25.165789 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:29:25.167793 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_concurrency.lockutils [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=104195) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:29:25.169415 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO dbcounter [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Registered counter for database nova_cell1 Oct 12 12:29:25.169780 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO dbcounter [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Registered counter for database nova_cell0 Oct 12 12:29:25.173763 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO dbcounter [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Registered counter for database nova_cell1 Oct 12 12:29:25.176669 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_db.sqlalchemy.engines [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.178705 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_db.sqlalchemy.engines [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.181110 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_db.sqlalchemy.engines [None req-65a3e316-9030-4746-948a-a141e327e787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.184762 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_db.sqlalchemy.engines [None req-65a3e316-9030-4746-948a-a141e327e787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.184894 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writer thread running {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.187492 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writer thread running {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.190335 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writer thread running {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.195558 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writer thread running {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.329690 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO dbcounter [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Registered counter for database nova_cell0 Oct 12 12:29:25.337225 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO dbcounter [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Registered counter for database nova_cell0 Oct 12 12:29:25.339233 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_db.sqlalchemy.engines [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104194) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.343753 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writer thread running {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.347924 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG oslo_db.sqlalchemy.engines [None req-65a3e316-9030-4746-948a-a141e327e787 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104195) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:29:25.353545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writer thread running {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:29:25.721429 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: WARNING keystonemiddleware.auth_token [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:29:25.728732 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: WARNING keystonemiddleware.auth_token [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:29:25.745136 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: WARNING keystonemiddleware.auth_token [None req-65a3e316-9030-4746-948a-a141e327e787 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:29:25.752422 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: WARNING keystonemiddleware.auth_token [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:29:26.071390 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: WARNING keystonemiddleware.auth_token [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:29:26.077341 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: WARNING keystonemiddleware.auth_token [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:29:26.082912 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56451fb2f9c0 pid: 104194 (default app) Oct 12 12:29:26.084973 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:29:26.086203 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] 10.222.0.44 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001725 Oct 12 12:29:26.086632 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 1/1] 10.222.0.44 () {50 vars in 788 bytes} [Wed Oct 12 12:29:26 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:29:26.090768 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: WARNING keystonemiddleware.auth_token [None req-65a3e316-9030-4746-948a-a141e327e787 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:29:26.096682 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: WARNING keystonemiddleware.auth_token [None req-65a3e316-9030-4746-948a-a141e327e787 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:29:26.101891 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56451fb2f9c0 pid: 104195 (default app) Oct 12 12:30:51.105113 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:30:51.106416 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001425 Oct 12 12:30:51.106826 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 2/2] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:30:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:30:51.118541 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_api:SELECT=3 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:51.119490 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_cell0:SELECT=3 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:51.120484 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_cell1:SELECT=3 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:51.122588 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:51.971566 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-01bc6cdd-335e-4f1c-a736-b06e455f09dd admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:30:52.005438 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-01bc6cdd-335e-4f1c-a736-b06e455f09dd admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.891955 Oct 12 12:30:52.006196 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 1/3] 10.222.0.44 () {60 vars in 1292 bytes} [Wed Oct 12 12:30:51 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:30:54.616360 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:30:54.617276 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-db67b420-2e34-4863-9e31-5604ea58bf94 None None] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001386 Oct 12 12:30:54.623664 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 3/4] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:30:54 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:30:55.061061 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-2cb004bf-3868-4cd5-bd30-9338e9dbc091 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "swap": 0, "id": "c1", "name": "cirros256", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:30:55.159890 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-2cb004bf-3868-4cd5-bd30-9338e9dbc091 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.535961 Oct 12 12:30:55.160480 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 2/5] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:30:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:30:55.175835 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_api:SELECT=3 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:55.175835 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_cell1:SELECT=3 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:55.177003 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_cell0:SELECT=3 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:55.177750 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:30:55.385664 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-7cb82aca-8f49-40e0-87cb-bb611fd21f49 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:30:55.497309 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-7cb82aca-8f49-40e0-87cb-bb611fd21f49 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.326654 Oct 12 12:30:55.497309 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 4/6] 10.222.0.44 () {64 vars in 1336 bytes} [Wed Oct 12 12:30:55 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:30:58.091582 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-2cb004bf-3868-4cd5-bd30-9338e9dbc091 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:30:58.092605 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-2cb004bf-3868-4cd5-bd30-9338e9dbc091 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Oct 12 12:30:58.093007 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 3/7] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:30:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:30:58.761617 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-2ba71b3e-3fdb-41c6-970b-e526a88c3bb2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d1", "disk": 5, "ram": 512, "name": "ds512M", "swap": 0, "vcpus": 1}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:30:58.876609 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-2ba71b3e-3fdb-41c6-970b-e526a88c3bb2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.777356 Oct 12 12:30:58.877237 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 5/8] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:30:58 2022] POST /compute/v2.1/flavors => generated 404 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:30:58.889726 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-ac2ce18e-c5c4-4856-8226-331748028865 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:30:59.012015 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-ac2ce18e-c5c4-4856-8226-331748028865 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126112 Oct 12 12:30:59.012667 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 4/9] 10.222.0.44 () {64 vars in 1336 bytes} [Wed Oct 12 12:30:58 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:01.596763 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-2ba71b3e-3fdb-41c6-970b-e526a88c3bb2 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:01.597687 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-2ba71b3e-3fdb-41c6-970b-e526a88c3bb2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Oct 12 12:31:01.598327 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 6/10] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:02.008464 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-4d3b3057-df9b-43fc-868d-004380118763 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "os-flavor-access:is_public": true, "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:02.060026 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-4d3b3057-df9b-43fc-868d-004380118763 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.454698 Oct 12 12:31:02.060595 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 5/11] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:01 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:02.073280 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-30ff5b1e-d307-4728-835d-5520358d2744 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:02.155663 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-30ff5b1e-d307-4728-835d-5520358d2744 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086099 Oct 12 12:31:02.156216 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 7/12] 10.222.0.44 () {64 vars in 1336 bytes} [Wed Oct 12 12:31:02 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:04.738639 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-4d3b3057-df9b-43fc-868d-004380118763 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:04.739561 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-4d3b3057-df9b-43fc-868d-004380118763 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Oct 12 12:31:04.739957 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 6/13] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:31:05.153832 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-bd3596b6-17ce-4e3d-bc29-6b500c3e80bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "swap": 0}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:05.225570 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-bd3596b6-17ce-4e3d-bc29-6b500c3e80bf admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479203 Oct 12 12:31:05.233096 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 8/14] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:05.239734 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-0c37e9b1-de6c-4408-abb7-8d4d1dfbc2e5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:05.326502 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-0c37e9b1-de6c-4408-abb7-8d4d1dfbc2e5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.090437 Oct 12 12:31:05.327131 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 7/15] 10.222.0.44 () {64 vars in 1336 bytes} [Wed Oct 12 12:31:05 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:07.954543 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-bd3596b6-17ce-4e3d-bc29-6b500c3e80bf admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:07.955875 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-bd3596b6-17ce-4e3d-bc29-6b500c3e80bf admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Oct 12 12:31:07.956366 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 9/16] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:08.403418 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "ds4G", "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 4096, "id": "d4", "vcpus": 4}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:08.470571 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.504779 Oct 12 12:31:08.471208 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 8/17] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:08.485186 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-7fa39874-36cc-466c-b063-0819f4936db5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:08.557024 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-7fa39874-36cc-466c-b063-0819f4936db5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076933 Oct 12 12:31:08.557790 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 10/18] 10.222.0.44 () {64 vars in 1336 bytes} [Wed Oct 12 12:31:08 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:11.271699 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:11.272712 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Oct 12 12:31:11.273339 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 9/19] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:11.685418 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-ad4779cf-5e7d-4d02-9a50-b3e7e852dd2c admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:11.708914 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-ad4779cf-5e7d-4d02-9a50-b3e7e852dd2c admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.429466 Oct 12 12:31:11.709389 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 11/20] 10.222.0.44 () {60 vars in 1292 bytes} [Wed Oct 12 12:31:11 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:31:14.267983 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:14.268900 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-6897ea74-4fba-499b-8c55-37c2288a23fd admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001445 Oct 12 12:31:14.269304 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 10/21] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:14.661518 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-97b530cc-84b2-414a-ad09-29563b850aae admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "disk": 1, "ram": 512, "os-flavor-access:is_public": true, "name": "m1.tiny", "id": "1", "swap": 0}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:14.735314 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-97b530cc-84b2-414a-ad09-29563b850aae admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459593 Oct 12 12:31:14.735861 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 12/22] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:14.748275 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-5aab285b-6978-49b7-9305-135006454136 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:14.817330 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-5aab285b-6978-49b7-9305-135006454136 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.072627 Oct 12 12:31:14.817835 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 11/23] 10.222.0.44 () {64 vars in 1333 bytes} [Wed Oct 12 12:31:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:31:17.404952 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-97b530cc-84b2-414a-ad09-29563b850aae admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:17.406081 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-97b530cc-84b2-414a-ad09-29563b850aae admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Oct 12 12:31:17.406470 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 13/24] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:17.822161 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-b9c48e1e-01c6-490a-ac6b-cfe034323750 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small", "disk": 20, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 1}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:17.876135 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-b9c48e1e-01c6-490a-ac6b-cfe034323750 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.463610 Oct 12 12:31:17.876748 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 12/25] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:17.889336 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-570cb956-3369-42cd-8275-dd546bf1641c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:17.953693 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-570cb956-3369-42cd-8275-dd546bf1641c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.068025 Oct 12 12:31:17.954294 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 14/26] 10.222.0.44 () {64 vars in 1333 bytes} [Wed Oct 12 12:31:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:20.589314 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-b9c48e1e-01c6-490a-ac6b-cfe034323750 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:20.590445 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-b9c48e1e-01c6-490a-ac6b-cfe034323750 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001657 Oct 12 12:31:20.591116 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 13/27] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:21.027124 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-9964bfd6-ae8a-4f57-ac07-c6900b5c9071 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "3", "swap": 0, "ram": 4096, "vcpus": 2, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.medium"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:21.088684 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-9964bfd6-ae8a-4f57-ac07-c6900b5c9071 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.491384 Oct 12 12:31:21.094280 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 15/28] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:20 2022] POST /compute/v2.1/flavors => generated 406 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:21.101590 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-af50208c-6cb0-4138-8ea3-6d209ebc2d67 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:21.180250 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:21.186280 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-af50208c-6cb0-4138-8ea3-6d209ebc2d67 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.088400 Oct 12 12:31:21.194491 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 14/29] 10.222.0.44 () {64 vars in 1333 bytes} [Wed Oct 12 12:31:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:23.824753 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-9964bfd6-ae8a-4f57-ac07-c6900b5c9071 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:23.826454 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-9964bfd6-ae8a-4f57-ac07-c6900b5c9071 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002143 Oct 12 12:31:23.827037 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 16/30] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:24.272146 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-9f49fdea-f39c-48e9-a1cb-6f96fdcdca09 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:24.351457 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-9f49fdea-f39c-48e9-a1cb-6f96fdcdca09 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518288 Oct 12 12:31:24.352016 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 15/31] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:23 2022] POST /compute/v2.1/flavors => generated 405 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:31:24.364875 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-840ba641-4e14-4901-a311-6a2cc3df246c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:24.428879 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-840ba641-4e14-4901-a311-6a2cc3df246c admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.067530 Oct 12 12:31:24.429575 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 17/32] 10.222.0.44 () {64 vars in 1333 bytes} [Wed Oct 12 12:31:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:27.021133 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-9f49fdea-f39c-48e9-a1cb-6f96fdcdca09 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:27.022239 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-9f49fdea-f39c-48e9-a1cb-6f96fdcdca09 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001590 Oct 12 12:31:27.022723 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 16/33] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:27.463060 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "disk": 160, "ram": 16384, "rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:27.473736 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:27.550759 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.521832 Oct 12 12:31:27.558333 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 18/34] 10.222.0.44 () {64 vars in 1283 bytes} [Wed Oct 12 12:31:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:27.564277 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-4be0703a-f9c6-418a-9400-e5daa4f5312b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:27.644395 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-4be0703a-f9c6-418a-9400-e5daa4f5312b admin admin] 10.222.0.44 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.083956 Oct 12 12:31:27.645296 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 17/35] 10.222.0.44 () {64 vars in 1333 bytes} [Wed Oct 12 12:31:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:31:44.974973 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:44.975905 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Oct 12 12:31:44.976309 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 19/36] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:31:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:44.988065 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_api:SELECT=10,nova_api:INSERT=2,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:31:45.369082 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-062396e9-aca8-4d5c-88d6-bf0afa9f9a6d admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:45.386953 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-062396e9-aca8-4d5c-88d6-bf0afa9f9a6d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.403844 Oct 12 12:31:45.387490 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 18/37] 10.222.0.44 () {60 vars in 1292 bytes} [Wed Oct 12 12:31:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:31:46.689437 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:46.690476 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-70a3ba09-d744-4610-9e81-10876ddd0ea2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Oct 12 12:31:46.690866 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 20/38] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:47.205004 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6e67dad4-6d52-40cb-9c22-8ca90a1901f9 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:47.210181 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.wsgi [None req-6e67dad4-6d52-40cb-9c22-8ca90a1901f9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6e67dad4-6d52-40cb-9c22-8ca90a1901f9 admin admin] Request method failure captured: Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept: application/json Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept-Encoding: gzip, deflate Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Connection: keep-alive Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Content-Length: 0 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Host: 10.222.0.44 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-System-Scope: None Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: User-Agent: python-novaclient Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Auth-Token: gAAAAABjRrOyW_o6UJGt4BBEmmeKp4m3yAMgdTnYxaIPsCF7yLRN5SdCXG5WlqmbfDeKN1MU1OwuSMINLiOA5DU6oGGMAkoWPxLKOwTnksfRKYyoFNmtybIFiaafBPQQRIiH14RQxEW0JEcHNeFpoEdQstZkuG5VozxB1rCHjJTn6HS5ZreWnnU Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Id: None Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Name: None Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Identity-Status: Confirmed Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Is-Admin-Project: True Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Id: default Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Name: Default Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Name: admin Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Role: member,reader,admin Oct 12 12:31:47.214021 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Roles: member,reader,admin Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant: admin Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Name: admin Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User: admin Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Id: default Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Name: Default Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Name: admin Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: method: > Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: exception: Flavor 42 could not be found. Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: action_args: {'id': '42'} Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:47.215578 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:47.216545 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.217658 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-6e67dad4-6d52-40cb-9c22-8ca90a1901f9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:47.218710 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-6e67dad4-6d52-40cb-9c22-8ca90a1901f9 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.388340 Oct 12 12:31:47.218710 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 19/39] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Oct 12 12:31:46 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 12:31:47.225849 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-ede9544c-5612-44e6-a091-7e16dc1fbcef admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:47.248548 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-ede9544c-5612-44e6-a091-7e16dc1fbcef admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026624 Oct 12 12:31:47.248748 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 21/40] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:31:47.259863 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-518b90e4-2f6f-42b4-8b62-2fed15637f14 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:47.280936 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-518b90e4-2f6f-42b4-8b62-2fed15637f14 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026141 Oct 12 12:31:47.281459 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 20/41] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:47 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:31:47.290515 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-4c210bd6-50a3-49d1-ab6f-b132a66b6c9a admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:47.296174 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.wsgi [None req-4c210bd6-50a3-49d1-ab6f-b132a66b6c9a admin admin] HTTP exception thrown: Flavor 42 could not be found. Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-4c210bd6-50a3-49d1-ab6f-b132a66b6c9a admin admin] Request method failure captured: Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept: application/json Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept-Encoding: gzip, deflate Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Connection: keep-alive Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Content-Length: 0 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Host: 10.222.0.44 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-System-Scope: None Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: User-Agent: python-novaclient Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Auth-Token: gAAAAABjRrOyW_o6UJGt4BBEmmeKp4m3yAMgdTnYxaIPsCF7yLRN5SdCXG5WlqmbfDeKN1MU1OwuSMINLiOA5DU6oGGMAkoWPxLKOwTnksfRKYyoFNmtybIFiaafBPQQRIiH14RQxEW0JEcHNeFpoEdQstZkuG5VozxB1rCHjJTn6HS5ZreWnnU Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Id: None Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Name: None Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Identity-Status: Confirmed Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Is-Admin-Project: True Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Id: default Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Name: Default Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Name: admin Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Role: member,reader,admin Oct 12 12:31:47.299503 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Roles: member,reader,admin Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant: admin Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Name: admin Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User: admin Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Id: default Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Name: Default Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Name: admin Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: method: > Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: exception: Flavor 42 could not be found. Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: action_args: {'id': '42'} Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:47.307376 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:47.308291 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:47.309526 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-4c210bd6-50a3-49d1-ab6f-b132a66b6c9a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=104194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:47.310836 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-4c210bd6-50a3-49d1-ab6f-b132a66b6c9a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013859 Oct 12 12:31:47.310836 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 22/42] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Oct 12 12:31:47 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 12:31:48.517242 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-518b90e4-2f6f-42b4-8b62-2fed15637f14 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:48.518298 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-518b90e4-2f6f-42b4-8b62-2fed15637f14 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Oct 12 12:31:48.518699 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 21/43] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:49.033878 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-1ecc5046-354a-4712-b4b3-29b6f421d357 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:49.038830 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.wsgi [None req-1ecc5046-354a-4712-b4b3-29b6f421d357 admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-1ecc5046-354a-4712-b4b3-29b6f421d357 admin admin] Request method failure captured: Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept: application/json Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept-Encoding: gzip, deflate Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Connection: keep-alive Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Content-Length: 0 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Host: 10.222.0.44 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-System-Scope: None Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: User-Agent: python-novaclient Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Auth-Token: gAAAAABjRrO03c3Bfh2AQbkc82PRv_cZbIu4CG7Npd8F_QdI1gvDoal-vqX90v65pn1aAb4nKGk6R3M7sXjZcxTmct6ek9W77qnzc94-C_rfVg_gRXJHe02QpD7YjIGBbb_tlfhLaEsyB_kMRuPEtCBrR2vvIhNJzWlcdvk9LCTfzyQGB0QFuro Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Id: None Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Name: None Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Identity-Status: Confirmed Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Is-Admin-Project: True Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Id: default Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Name: Default Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Name: admin Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Role: member,reader,admin Oct 12 12:31:49.040920 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Roles: member,reader,admin Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant: admin Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Name: admin Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User: admin Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Id: default Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Name: Default Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Name: admin Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: method: > Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: exception: Flavor 84 could not be found. Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: action_args: {'id': '84'} Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:49.042459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:49.043340 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.044469 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-1ecc5046-354a-4712-b4b3-29b6f421d357 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:49.045477 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-1ecc5046-354a-4712-b4b3-29b6f421d357 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.389135 Oct 12 12:31:49.045477 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 23/44] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Oct 12 12:31:48 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 390 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:49.052103 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-9906fb17-b791-40f9-bfcf-64dc8bc35e0f admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:49.067298 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-9906fb17-b791-40f9-bfcf-64dc8bc35e0f admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018786 Oct 12 12:31:49.067849 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 22/45] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:31:49.078194 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-c40040de-c67b-4b1c-8bbe-98eab4cde83d admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:49.093302 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-c40040de-c67b-4b1c-8bbe-98eab4cde83d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018763 Oct 12 12:31:49.093814 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 24/46] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:31:49.103448 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-b2db3b7f-b29d-40d0-8e4b-55703166ae9a admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:49.108677 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.wsgi [None req-b2db3b7f-b29d-40d0-8e4b-55703166ae9a admin admin] HTTP exception thrown: Flavor 84 could not be found. Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-b2db3b7f-b29d-40d0-8e4b-55703166ae9a admin admin] Request method failure captured: Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept: application/json Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept-Encoding: gzip, deflate Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Connection: keep-alive Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Content-Length: 0 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Host: 10.222.0.44 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-System-Scope: None Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: User-Agent: python-novaclient Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Auth-Token: gAAAAABjRrO03c3Bfh2AQbkc82PRv_cZbIu4CG7Npd8F_QdI1gvDoal-vqX90v65pn1aAb4nKGk6R3M7sXjZcxTmct6ek9W77qnzc94-C_rfVg_gRXJHe02QpD7YjIGBbb_tlfhLaEsyB_kMRuPEtCBrR2vvIhNJzWlcdvk9LCTfzyQGB0QFuro Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Id: None Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Name: None Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Identity-Status: Confirmed Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Is-Admin-Project: True Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Id: default Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Name: Default Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Name: admin Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Role: member,reader,admin Oct 12 12:31:49.110205 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Roles: member,reader,admin Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant: admin Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Name: admin Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User: admin Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Id: default Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Name: Default Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Name: admin Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: method: > Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: exception: Flavor 84 could not be found. Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: action_args: {'id': '84'} Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:49.111709 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:49.112619 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:49.113991 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-b2db3b7f-b29d-40d0-8e4b-55703166ae9a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=104195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:49.115237 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-b2db3b7f-b29d-40d0-8e4b-55703166ae9a admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012120 Oct 12 12:31:49.115237 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 23/47] 10.222.0.44 () {60 vars in 1190 bytes} [Wed Oct 12 12:31:49 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Oct 12 12:31:50.320918 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-c40040de-c67b-4b1c-8bbe-98eab4cde83d admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:50.321864 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-c40040de-c67b-4b1c-8bbe-98eab4cde83d admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 12 12:31:50.322294 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 25/48] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:50.859980 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-3dd921cc-6b49-414a-adc3-4e3a4ac92664 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:50.865829 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.wsgi [None req-3dd921cc-6b49-414a-adc3-4e3a4ac92664 admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-3dd921cc-6b49-414a-adc3-4e3a4ac92664 admin admin] Request method failure captured: Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept: application/json Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Accept-Encoding: gzip, deflate Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Connection: keep-alive Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Content-Length: 0 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Host: 10.222.0.44 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Openstack-System-Scope: None Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: User-Agent: python-novaclient Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Auth-Token: gAAAAABjRrO2khsvEs82SChNew9IhDClImBjtCCLYz63ZRSF9ISfcCo9fNTiz8-idiWyuWsKxOTeLKPM46s11zkBzn82TI58QR-mbstZvXYPKmq23qCgr-cneWRhA-HjTL5vM4eLs3VIxQVx_5-8XhzF8MP4j8p5wC653Ea57c8L7WqmjeP50Tw Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Id: None Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Domain-Name: None Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Identity-Status: Confirmed Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Is-Admin-Project: True Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Id: default Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Domain-Name: Default Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Project-Name: admin Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Role: member,reader,admin Oct 12 12:31:50.867396 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Roles: member,reader,admin Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant: admin Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-Tenant-Name: admin Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User: admin Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Id: default Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Domain-Name: Default Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: X-User-Name: admin Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: method: > Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: exception: Flavor 451 could not be found. Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: action_args: {'id': '451'} Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:50.868955 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:50.869901 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.871032 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-3dd921cc-6b49-414a-adc3-4e3a4ac92664 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104195) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:50.872044 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-3dd921cc-6b49-414a-adc3-4e3a4ac92664 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.410850 Oct 12 12:31:50.872044 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 24/49] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:31:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 412 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:50.878598 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-3ada6fab-73d0-4ba6-babe-9eebaedb3bc8 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:50.893793 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-3ada6fab-73d0-4ba6-babe-9eebaedb3bc8 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018834 Oct 12 12:31:50.894348 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 26/50] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:31:50.904201 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:50.919752 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019068 Oct 12 12:31:50.920276 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 25/51] 10.222.0.44 () {60 vars in 1210 bytes} [Wed Oct 12 12:31:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:31:50.929238 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70e47070-47fb-4cb8-9d3f-08d5f312f50d admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:50.934704 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.wsgi [None req-70e47070-47fb-4cb8-9d3f-08d5f312f50d admin admin] HTTP exception thrown: Flavor 451 could not be found. Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70e47070-47fb-4cb8-9d3f-08d5f312f50d admin admin] Request method failure captured: Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept: application/json Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Accept-Encoding: gzip, deflate Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Connection: keep-alive Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Content-Length: 0 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Host: 10.222.0.44 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-Api-Version: compute 2.92 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Openstack-System-Scope: None Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: User-Agent: python-novaclient Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Auth-Token: gAAAAABjRrO2khsvEs82SChNew9IhDClImBjtCCLYz63ZRSF9ISfcCo9fNTiz8-idiWyuWsKxOTeLKPM46s11zkBzn82TI58QR-mbstZvXYPKmq23qCgr-cneWRhA-HjTL5vM4eLs3VIxQVx_5-8XhzF8MP4j8p5wC653Ea57c8L7WqmjeP50Tw Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Id: None Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Domain-Name: None Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Identity-Status: Confirmed Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Is-Admin-Project: True Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Openstack-Nova-Api-Version: 2.92 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Id: default Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Domain-Name: Default Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Project-Name: admin Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Role: member,reader,admin Oct 12 12:31:50.936211 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Roles: member,reader,admin Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/5655a305f69b4cb0901b114b25e5c478"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_5655a305f69b4cb0901b114b25e5c478", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant: admin Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Id: 5655a305f69b4cb0901b114b25e5c478 Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-Tenant-Name: admin Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User: admin Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Id: default Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Domain-Name: Default Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Id: cd7cad0b678b4f0182359eae55570531 Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: X-User-Name: admin Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: method: > Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: exception: Flavor 451 could not be found. Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: action_args: {'id': '451'} Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:31:50.938586 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:50.939983 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: ERROR nova.api.openstack.wsgi Oct 12 12:31:50.941963 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-70e47070-47fb-4cb8-9d3f-08d5f312f50d admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=104194) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:31:50.943953 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-70e47070-47fb-4cb8-9d3f-08d5f312f50d admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011817 Oct 12 12:31:50.943953 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 27/52] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:31:50 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Oct 12 12:31:52.137863 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:52.138956 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Oct 12 12:31:52.139355 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 26/53] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:52.657900 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-a665f7a1-1be3-4ad9-8ffe-b2de3e421d49 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:52.726828 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-a665f7a1-1be3-4ad9-8ffe-b2de3e421d49 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.450369 Oct 12 12:31:52.727453 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 28/54] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Oct 12 12:31:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:53.937116 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:53.938226 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Oct 12 12:31:53.938628 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 27/55] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:54.452674 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-09acedf1-2837-486a-9706-06d00fe8a0e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:54.522512 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-09acedf1-2837-486a-9706-06d00fe8a0e5 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.446921 Oct 12 12:31:54.524083 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 29/56] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Oct 12 12:31:54 2022] POST /compute/v2.1/flavors => generated 405 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:31:55.730160 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:55.731190 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Oct 12 12:31:55.731720 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 28/57] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:56.251350 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-990f47e8-e4f5-4538-a608-93cd25b5a23a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:56.311313 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-990f47e8-e4f5-4538-a608-93cd25b5a23a admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.439956 Oct 12 12:31:56.311857 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 30/58] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Oct 12 12:31:55 2022] POST /compute/v2.1/flavors => generated 407 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:31:57.522540 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:57.523559 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Oct 12 12:31:57.523954 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 29/59] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:31:58.041647 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-c6a8a927-88cb-4ffb-82ed-03b24eecf705 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:31:58.117474 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-c6a8a927-88cb-4ffb-82ed-03b24eecf705 admin admin] 10.222.0.44 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.456265 Oct 12 12:31:58.118089 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 31/60] 10.222.0.44 () {64 vars in 1235 bytes} [Wed Oct 12 12:31:57 2022] POST /compute/v2.1/flavors => generated 409 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:31:59.322957 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:59.323890 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Oct 12 12:31:59.324277 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 30/61] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:31:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:31:59.840839 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-10b4d6d0-a69d-4283-a5fd-e7b3d04cd9ac admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:31:59.861386 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-10b4d6d0-a69d-4283-a5fd-e7b3d04cd9ac admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401848 Oct 12 12:31:59.861988 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 32/62] 10.222.0.44 () {60 vars in 1202 bytes} [Wed Oct 12 12:31:59 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:32:56.125199 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-29449522-6dac-4e82-b300-252be89283af admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.126258 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-29449522-6dac-4e82-b300-252be89283af admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001889 Oct 12 12:32:56.126664 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 31/63] 10.222.0.44 () {54 vars in 931 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:32:56.137770 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:56.519039 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-85d929d2-e744-41fe-9c42-4fe1707728a6 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.539135 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-85d929d2-e744-41fe-9c42-4fe1707728a6 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406295 Oct 12 12:32:56.539677 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 33/64] 10.222.0.44 () {60 vars in 1292 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:32:56.560896 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_api:SELECT=14 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:32:56.564623 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-16cdd018-5468-401f-aae0-2b401a1ef2f7 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.572514 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-16cdd018-5468-401f-aae0-2b401a1ef2f7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013007 Oct 12 12:32:56.573035 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 32/65] 10.222.0.44 () {60 vars in 1283 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:32:56.584378 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-fdc92d93-b40d-4f8d-8abd-f8b417171a22 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.591640 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-fdc92d93-b40d-4f8d-8abd-f8b417171a22 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010859 Oct 12 12:32:56.592144 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 34/66] 10.222.0.44 () {60 vars in 1286 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:32:56.603644 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.610995 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011296 Oct 12 12:32:56.611506 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 33/67] 10.222.0.44 () {60 vars in 1286 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:32:56.623201 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-200d0426-7d0b-49a7-8b4a-27bb029cd0c7 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:32:56.630117 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-200d0426-7d0b-49a7-8b4a-27bb029cd0c7 admin admin] 10.222.0.44 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010362 Oct 12 12:32:56.630630 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 35/68] 10.222.0.44 () {60 vars in 1283 bytes} [Wed Oct 12 12:32:56 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:36:04.089725 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:04.090754 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Oct 12 12:36:04.091150 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 34/69] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:36:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:36:04.230428 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_api:SELECT=6 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:04.387520 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:04.392145 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:04.392615 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:04.393043 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:04.393751 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:04.394234 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:04.394654 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:04.427001 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-84c4a2bc-4a9c-4174-a28c-26332a32dfe2 admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.197830 Oct 12 12:36:04.427550 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 36/70] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:36:04 2022] GET /compute/v2.1/os-services => generated 794 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:36:05.502242 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:05.503234 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Oct 12 12:36:05.503631 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 35/71] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:36:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:36:05.690695 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:05.694109 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:05.694613 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:05.695037 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:05.695739 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:05.696186 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:05.696597 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:05.715972 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-fa9df0f4-e539-43fc-9629-d3900e40c76b admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.075539 Oct 12 12:36:05.716459 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 37/72] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:36:05 2022] GET /compute/v2.1/os-services => generated 794 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:36:17.179660 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:17.180654 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Oct 12 12:36:17.181050 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 36/73] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:36:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:36:17.322752 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_cell0:SELECT=4 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:17.323418 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_cell1:SELECT=4 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:17.324014 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG dbcounter [-] [104194] Writing DB stats nova_api:SELECT=8 {{(pid=104194) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:36:17.372100 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:17.376061 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:17.376528 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:17.376945 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:17.377638 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:17.378106 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:17.378513 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:17.404076 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-7d229eae-6dd1-4bec-b6a9-4b6685a4a20a admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.085700 Oct 12 12:36:17.404618 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 38/74] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:36:17 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:36:18.470105 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG nova.api.openstack.wsgi [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] Calling method '>' {{(pid=104195) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:18.471120 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: INFO nova.api.openstack.requestlog [None req-144a6b6a-6a08-4ea6-80b2-85faef416dc2 admin admin] 10.222.0.44 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 Oct 12 12:36:18.471507 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: [pid: 104195|app: 0|req: 37/75] 10.222.0.44 () {56 vars in 1074 bytes} [Wed Oct 12 12:36:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:36:18.662499 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG nova.api.openstack.wsgi [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Calling method '>' {{(pid=104194) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:36:18.665875 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:18.666375 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:18.666798 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:18.667508 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:36:18.667956 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:36:18.668372 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: DEBUG oslo_concurrency.lockutils [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=104194) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:36:18.690388 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: INFO nova.api.openstack.requestlog [None req-315e631e-7d17-4577-9563-ba4a0e6f79fe admin admin] 10.222.0.44 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.079071 Oct 12 12:36:18.690883 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: [pid: 104194|app: 0|req: 39/76] 10.222.0.44 () {60 vars in 1193 bytes} [Wed Oct 12 12:36:18 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:37:15.284472 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: Wed Oct 12 12:37:15 2022 - graceful shutdown triggered... Oct 12 12:37:15.284254 dv-cinder-812685-16-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Oct 12 12:37:15.285396 dv-cinder-812685-16-iscsi devstack@n-api.service[104194]: Gracefully killing worker 1 (pid: 104194)... Oct 12 12:37:15.285756 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: Gracefully killing worker 2 (pid: 104195)... Oct 12 12:37:15.412785 dv-cinder-812685-16-iscsi devstack@n-api.service[104195]: DEBUG dbcounter [-] [104195] Writing DB stats nova_api:SELECT=4 {{(pid=104195) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:16.284618 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: worker 1 buried after 1 seconds Oct 12 12:37:16.285085 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: worker 2 buried after 1 seconds Oct 12 12:37:16.285085 dv-cinder-812685-16-iscsi devstack@n-api.service[104193]: goodbye to uWSGI. Oct 12 12:37:16.286225 dv-cinder-812685-16-iscsi systemd[1]: devstack@n-api.service: Succeeded. Oct 12 12:37:16.286770 dv-cinder-812685-16-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Oct 12 12:37:16.289524 dv-cinder-812685-16-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Oct 12 12:37:16.299704 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Oct 12 12:37:16 2022] *** Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: nodename: dv-cinder-812685-16-iscsi Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: machine: x86_64 Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: clock source: unix Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: pcre jit disabled Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: detected number of CPU cores: 4 Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: current working directory: / Oct 12 12:37:16.301713 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: detected binary path: /usr/bin/uwsgi-core Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: your processes number limit is 47680 Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: your memory page size is 4096 bytes Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: detected max file descriptor number: 2048 Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: lock engine: pthread robust mutexes Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: thunder lock: enabled Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Oct 12 12:37:16.302486 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Oct 12 12:37:16.341259 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: Python main interpreter initialized at 0x5639e2d8d9c0 Oct 12 12:37:16.341259 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: python threads support enabled Oct 12 12:37:16.341259 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: your server socket listen backlog is limited to 100 connections Oct 12 12:37:16.341259 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: your mercy for graceful operations on workers is 90 seconds Oct 12 12:37:16.341649 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: mapped 403077 bytes (393 KB) for 2 cores Oct 12 12:37:16.341649 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: *** Operational MODE: preforking *** Oct 12 12:37:16.341903 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: *** uWSGI is running in multiple interpreter mode *** Oct 12 12:37:16.341903 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: spawned uWSGI master process (pid: 130847) Oct 12 12:37:16.342141 dv-cinder-812685-16-iscsi systemd[1]: Started Devstack devstack@n-api.service. Oct 12 12:37:16.342755 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: spawned uWSGI worker 1 (pid: 130866, cores: 1) Oct 12 12:37:16.343301 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: spawned uWSGI worker 2 (pid: 130867, cores: 1) Oct 12 12:37:16.343714 dv-cinder-812685-16-iscsi devstack@n-api.service[130847]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Oct 12 12:37:17.003252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 12:37:17.003867 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Oct 12 12:37:18.161765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:37:18.161765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: from cryptography.utils import int_from_bytes Oct 12 12:37:18.162571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:37:18.162571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: from cryptography.utils import int_from_bytes Oct 12 12:37:18.166274 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:37:18.166274 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: from cryptography.utils import int_from_bytes Oct 12 12:37:18.166705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Oct 12 12:37:18.166705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: from cryptography.utils import int_from_bytes Oct 12 12:37:20.620818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:37:20.621482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:37:20.621763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:37:20.621991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:37:20.622256 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:37:20.622648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.622977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.623302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.623620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.623949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.624055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Oct 12 12:37:20.624432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Oct 12 12:37:20.624513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.624693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.624817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Oct 12 12:37:20.625162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.625273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Oct 12 12:37:20.625360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.625444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Oct 12 12:37:20.625633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.625840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.625974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.626148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.626389 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-16-iscsi {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.626501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.626829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.627433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.627713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.627996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.628319 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.628642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.629613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.629613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-812685-16-iscsi {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.630911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.631993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.632307 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.632484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.632661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.632917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.633230 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.633546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.633817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.634018 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.634295 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.634487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.634644 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.634912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.635090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.635245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.635875 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.636055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.636208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.636208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-16-iscsi {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.636504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.637592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.637592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.637592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.638568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.638568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.638568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.639621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.639621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.639621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.640359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.640510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.640671 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.640825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.640985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.641149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.641297 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.641443 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.641598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.641765 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.642049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.642217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.642891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.642891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.643245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-812685-16-iscsi {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.643409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.643581 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 4.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.643739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.643924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.644084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.644238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.644238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.645531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.645697 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646496 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.646972 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.650935 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.651866 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652213 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.652899 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.653997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654151 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.654998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.655144 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.655639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.655809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.655967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.656971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657749 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.657893 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.658935 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659709 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.659854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.660998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.44 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.44 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661775 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.661962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662726 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.662882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.664285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.664458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.664615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.664772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.664928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665527 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.665836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.666233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.666388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.666536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.667193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.667352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.667499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.667658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.667805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.669402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.669568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.669729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.669894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.670878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671026 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671336 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.671954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.674115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.674323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.674494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.674657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.674865 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.675109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.675260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.675748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.675899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.676912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.677901 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.678925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.679074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.679232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.679386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.682893 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.683892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.684808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.684953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.685099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.685099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.685405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.685553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.685699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.685844 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.686010 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.686248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.687680 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.687846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.687996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.688143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.688288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.688445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.688601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.688769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.688916 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.689070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.690113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.691050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.691211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.691369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.691553 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.691714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.691877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.692074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.692234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.692381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.692546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.694944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.695142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.695311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.695472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.695624 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Oct 12 12:37:20.695773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.695929 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.696976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697465 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.697982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.698932 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.699089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.699236 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.699381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.699526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.703219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.703437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.703623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.703783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.703944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704770 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.704932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.705827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.706881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707182 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.707923 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.708867 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709675 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.709871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.710076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.710246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.710401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.710573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.710743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.711363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.711529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.711686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.711841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.711995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712450 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712606 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.712898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713366 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.713827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.714933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.715244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.715681 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.715856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716342 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.716866 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.717824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718010 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718796 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.718957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.719913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720427 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.720905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.721604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.721769 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.721970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.722956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.723154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.723313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.723546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.723719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.723925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.724963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.725717 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.725896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.726930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727095 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727587 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727740 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.727900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.728978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.729992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.730165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.730320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.730527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.730687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.730848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.731001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.731181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.731875 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732378 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732695 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.732855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.733860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734707 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.734859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735011 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.735486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.736632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.736800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737162 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.737988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.738467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.739344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.739498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.739650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.739802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.739964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.740915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.741074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.741244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.742533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.742693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.742858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.743022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.743201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.743831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.743998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.744204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.744413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.744573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.744728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.744890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.745914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.746198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.746361 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.746527 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.746885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.747953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.748106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.748797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.748970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.748970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.749296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.749567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.749726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.749841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.758902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.759125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.759780 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.759992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.760166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.760325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.760488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.760663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.760818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761018 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761178 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.761829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.762013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.762205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.762466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.763018 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.763174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.763328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.763630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.763792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.764528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.764747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.764917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.765975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.766140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.766346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.766514 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.766709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.766885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.767040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.767263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.767433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.767599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.767881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.768053 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.768217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.768217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.768974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.769997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.770177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.770474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.770636 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.770831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.770990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.771949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.772194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.772358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.772642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.773160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.773337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.773501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.773771 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.773962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.774156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.774325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.774517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.774517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.774833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.775049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.775222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.775390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.775544 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.775696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.776446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.777269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.777463 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.777729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.777906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.778101 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.778733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.778954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.778954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.779457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.780380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.780605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.780605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781646 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.781926 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.782133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.782333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.782507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.782771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.784763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.784944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.785772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.793581 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.793696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.793807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.793910 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794912 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.794997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795261 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795786 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.795970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.796930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797550 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.797911 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.798045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.798138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.798229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.798337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.798430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.799927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.800967 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801060 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801564 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.801920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802561 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.802987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803159 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.803950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804742 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.804914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805491 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805828 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.805916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.806964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807052 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807052 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.807967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.808938 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809114 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.809897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810442 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810525 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.810802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811186 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.811983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.812062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.812705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.812804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.812899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.812992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.813906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814182 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814697 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814697 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.814951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815567 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.815921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816105 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816361 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816361 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.816937 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817466 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.817943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818537 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818910 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.818983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819769 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.819979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820724 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.820990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821683 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821780 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.821987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824200 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824838 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.824920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825002 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.825868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.826934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827595 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.827955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.828946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829202 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829366 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829540 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.829737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.830923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831109 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831543 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831709 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.831798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832863 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.832966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.833883 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834463 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.834966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835902 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.835987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836082 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836206 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836297 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.836926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837105 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.837977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838251 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.838891 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839469 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.839926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840762 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.840945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841481 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.841845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842002 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.842802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.843132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.843479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.843617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.843836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.843918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.844905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.845206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.845325 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.845974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.846082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.846322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.846419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.847744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.848995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.849884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.852856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.852987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853147 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853340 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853427 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.853899 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.854949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855883 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.855970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856683 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.856962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.857986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.858129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.858259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.858530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.858634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.858886 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859051 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859342 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.859956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.860899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.861672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.861809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862183 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.862985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.863123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.863293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.863429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.863613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864010 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864525 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.864978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.865166 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.865309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.865496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.865633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.865804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.866881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.867022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.867275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.867412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.867593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.867738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.868873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.869798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870730 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.870872 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871361 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871506 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871671 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.871977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872445 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.872985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.873566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.873716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.873851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874286 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.874980 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.875878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876492 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.876841 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.877019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.877163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.877548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.877687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.877818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878736 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.878878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879684 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.879965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880097 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880858 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.880997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881240 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881720 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.881975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887453 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.887963 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888721 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.888993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889727 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.889914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.890954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891469 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.891945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892828 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.892915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893101 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893481 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893671 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893759 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.893960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.894954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.895925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896108 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896832 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.896984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.897790 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.898757 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.899802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900325 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.900960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.901901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902058 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.902970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903806 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.903915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.904843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905051 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.905987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906598 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.906906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907024 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.907813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.908436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.908626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.908731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.908928 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.909874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910440 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.910876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911508 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.911947 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.912896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.913118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.913227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.913425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.913519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.913670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130867) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:37:20.913819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.914161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.914485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.914808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.915124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.915438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.915830 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.916148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.916461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.916776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.917087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.917402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.917711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.918071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.918402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.918748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.919019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.919339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.919661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.919979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.920295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.920628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.920943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.921256 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.921566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.921879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.922215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.922533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.922846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.923158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.923475 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.924329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.924656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.924982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.925291 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.925619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.925967 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.926334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.926624 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.926965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.927292 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.927611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.927923 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.928227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Oct 12 12:37:20.928469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=130866) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Oct 12 12:37:20.974693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO dbcounter [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Registered counter for database nova_api Oct 12 12:37:20.989316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO dbcounter [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Registered counter for database nova_api Oct 12 12:37:20.995790 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.002576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writer thread running {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.009113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.015698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writer thread running {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.058695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.context [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad657cf-e300-4750-943b-1f19054f5990(cell1) {{(pid=130867) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 12:37:21.062722 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:37:21.063197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:37:21.064831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:37:21.065568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:37:21.066044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:37:21.068095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:37:21.070147 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO dbcounter [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Registered counter for database nova_cell0 Oct 12 12:37:21.071362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.context [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5ad657cf-e300-4750-943b-1f19054f5990(cell1) {{(pid=130866) load_cells /opt/stack/nova/nova/context.py:464}} Oct 12 12:37:21.074349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO dbcounter [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Registered counter for database nova_cell1 Oct 12 12:37:21.075390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:37:21.075861 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:37:21.077444 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:37:21.078190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:37:21.078636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:37:21.080746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:37:21.081220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.082810 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO dbcounter [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Registered counter for database nova_cell0 Oct 12 12:37:21.085339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.086946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO dbcounter [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Registered counter for database nova_cell1 Oct 12 12:37:21.087053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writer thread running {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.094176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.096480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.102422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writer thread running {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.104495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writer thread running {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.231439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writer thread running {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.240993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO dbcounter [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Registered counter for database nova_cell0 Oct 12 12:37:21.247747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_db.sqlalchemy.engines [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130867) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.250702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO dbcounter [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Registered counter for database nova_cell0 Oct 12 12:37:21.252291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writer thread running {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.257498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_db.sqlalchemy.engines [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=130866) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Oct 12 12:37:21.261990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writer thread running {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Oct 12 12:37:21.577978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: WARNING keystonemiddleware.auth_token [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:37:21.581612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: WARNING keystonemiddleware.auth_token [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:37:21.585793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: WARNING keystonemiddleware.auth_token [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:37:21.588839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: WARNING keystonemiddleware.auth_token [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:37:21.933179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: WARNING keystonemiddleware.auth_token [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:37:21.939784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: WARNING keystonemiddleware.auth_token [None req-9aa7c77e-fde7-45f3-b645-fa06177fad49 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:37:21.941043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: WARNING keystonemiddleware.auth_token [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Oct 12 12:37:21.945316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5639e2d8d9c0 pid: 130867 (default app) Oct 12 12:37:21.947516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: WARNING keystonemiddleware.auth_token [None req-9c1bbb4a-1922-4ab8-a7f0-ae899fd803f9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Oct 12 12:37:21.952847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5639e2d8d9c0 pid: 130866 (default app) Oct 12 12:37:58.977152 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:58.978919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:58.980373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:37:58.982525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:00.445072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d799add4-07c7-412e-b44c-1e2e1829f02b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Action: 'create', calling method: .version_select at 0x7f9806349550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-911670400"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:02.306957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d799add4-07c7-412e-b44c-1e2e1829f02b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.354472 Oct 12 12:38:02.317593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 1/1] 10.222.0.44 () {60 vars in 1155 bytes} [Wed Oct 12 12:37:58 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3367 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Oct 12 12:38:02.323084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a4176ec2-a93a-4450-9f8c-841f8b85428b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980621e430>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:02.456087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a4176ec2-a93a-4450-9f8c-841f8b85428b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 200 len: 344 microversion: 2.1 time: 0.137132 Oct 12 12:38:02.457111 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 2/2] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:02 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 344 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:02.519193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0c2edfb1-e228-49e2-b7bd-3de10c77c6e0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f98063d30d0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:02.556710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:02.557544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:02.558687 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:02.559409 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:03.161355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0c2edfb1-e228-49e2-b7bd-3de10c77c6e0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/b41068c3-08f2-42b0-b0b5-cebc277bd442" status: 200 len: 351 microversion: 2.1 time: 0.944824 Oct 12 12:38:03.161355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 1/3] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:02 2022] GET /compute/v2.1/os-volumes/b41068c3-08f2-42b0-b0b5-cebc277bd442 => generated 351 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:03.471401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d9bd6384-29ab-4791-86e8-aeb6ff84dc39 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980621eaf0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:03.632432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d9bd6384-29ab-4791-86e8-aeb6ff84dc39 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 200 len: 345 microversion: 2.1 time: 0.160373 Oct 12 12:38:03.639263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 3/4] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:03 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 345 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:03.652808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c059efb9-af64-4ed6-b183-9df7fed944e2 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Action: 'create', calling method: .version_select at 0x7f980620b5e0>, body: {"snapshot": {"volume_id": "574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1017608118"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:04.398006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c059efb9-af64-4ed6-b183-9df7fed944e2 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.751537 Oct 12 12:38:04.398006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 2/5] 10.222.0.44 () {60 vars in 1162 bytes} [Wed Oct 12 12:38:03 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 753 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:04.411413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-10be2c80-cd7e-412c-b791-1f611d8f8c90 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b51f0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:04.613813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-10be2c80-cd7e-412c-b791-1f611d8f8c90 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 287 microversion: 2.1 time: 0.208083 Oct 12 12:38:04.615195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 4/6] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:04 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 287 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:04.626603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0111dae8-20a0-4a21-a9fd-03413569923b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980620b1f0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:04.870444 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0111dae8-20a0-4a21-a9fd-03413569923b tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.248094 Oct 12 12:38:04.877723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 3/7] 10.222.0.44 () {58 vars in 1140 bytes} [Wed Oct 12 12:38:04 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:04.884400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0a43844f-7f1c-4b58-8a8d-71f1c047d451 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980621ed30>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:05.065951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0a43844f-7f1c-4b58-8a8d-71f1c047d451 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 287 microversion: 2.1 time: 0.187016 Oct 12 12:38:05.066937 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 5/8] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:04 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 287 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:06.078979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-136b2948-8d50-4bbb-b0b5-09bf5bb4e7c5 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b1790>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:06.124586 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-136b2948-8d50-4bbb-b0b5-09bf5bb4e7c5 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 287 microversion: 2.1 time: 0.049386 Oct 12 12:38:06.130176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 4/9] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:06 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:07.138895 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e51a0629-8065-4920-b558-df63cf1652c1 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980621e670>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:07.178524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e51a0629-8065-4920-b558-df63cf1652c1 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 287 microversion: 2.1 time: 0.044934 Oct 12 12:38:07.183649 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 6/10] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:07 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:08.191207 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3eec9e21-121f-40d7-bee1-487e799b9608 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b1ee0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:08.245646 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3eec9e21-121f-40d7-bee1-487e799b9608 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 288 microversion: 2.1 time: 0.058082 Oct 12 12:38:08.246594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 5/11] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:08 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 288 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:08.257742 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6b390f27-4f89-433a-baa4-a61bb5ea8086 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b53a0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:08.582241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6b390f27-4f89-433a-baa4-a61bb5ea8086 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "DELETE /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 202 len: 0 microversion: 2.1 time: 0.328412 Oct 12 12:38:08.583205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 7/12] 10.222.0.44 () {58 vars in 1254 bytes} [Wed Oct 12 12:38:08 2022] DELETE /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:38:08.598710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5c7143b7-79cc-426c-9df1-ce8ee5f51776 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b1940>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:08.703474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5c7143b7-79cc-426c-9df1-ce8ee5f51776 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 200 len: 287 microversion: 2.1 time: 0.115324 Oct 12 12:38:08.704132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 6/13] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:08 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 287 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:09.143145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-924b941a-9782-4d00-a679-b8bbf73e7933 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f980621e5e0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:09.256523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-924b941a-9782-4d00-a679-b8bbf73e7933 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/96a10080-3c6f-44c9-84fe-ef9c687ec8f9" status: 200 len: 351 microversion: 2.1 time: 0.117238 Oct 12 12:38:09.257657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 8/14] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:09 2022] GET /compute/v2.1/os-volumes/96a10080-3c6f-44c9-84fe-ef9c687ec8f9 => generated 351 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:09.717192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f2101a7-c74b-4e96-919d-979ec17dd569 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98061b11f0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:10.406666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-9f2101a7-c74b-4e96-919d-979ec17dd569 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] HTTP exception thrown: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f2101a7-c74b-4e96-919d-979ec17dd569 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Request method failure captured: Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 HTTP/1.1 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUmDznbfDcXI7UgxVhBuKXn3L2o2AxH8gBtkSMap_5PBOP9k9uEDEiCDLIUy706eGJlI9UtKPvHFGbssFT1z6u-zEF5QFqXysuXd6laqZcIkmfZ28NTK9W3s5cHN08WjB7mvPGT7dKd3jgKQ9lAFVxlZ-gVWcjlK4FNLzNHwdfseBY Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:38:10.412238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2a372db0342f425cbd7dedccf68e7fd4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: b65fe96949fe4f87970dc5657b2125f5 Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'a0d49733-f461-4e17-97e9-b72f800101a7'} Oct 12 12:38:10.413642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. (HTTP 404) (Request-ID: req-729ea9fc-9b06-4cb0-96d4-9886e4d03619) Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.414482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:10.416162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Oct 12 12:38:10.417305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f2101a7-c74b-4e96-919d-979ec17dd569 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Returning 404 to user: Snapshot a0d49733-f461-4e17-97e9-b72f800101a7 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:38:10.419745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9f2101a7-c74b-4e96-919d-979ec17dd569 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7" status: 404 len: 111 microversion: 2.1 time: 0.700972 Oct 12 12:38:10.421499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 7/15] 10.222.0.44 () {58 vars in 1251 bytes} [Wed Oct 12 12:38:09 2022] GET /compute/v2.1/os-snapshots/a0d49733-f461-4e17-97e9-b72f800101a7 => generated 111 bytes in 702 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:38:10.423221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-60570d2f-7af3-4e91-a1c2-b47f9778600d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980620bee0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:10.564042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4731ec26-39f2-4113-a544-bf859cd060cd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: .version_select at 0x7f980621eaf0>, body: {"keypair": {"name": "tempest-keypair-1472153960", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkXU8VZYhL9XV5m70heRQEL7GNVXG7z0AdLdmWnuT5Md0bDO90D1nagIAbZqVMb8Zw+ZhvWZGnVmnJrMd4os70TtICwaW1ZQdcr0GWb/fPXsrXszJH6fyWNOqPuqOjaRQ=="}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:10.694531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-4731ec26-39f2-4113-a544-bf859cd060cd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:10.719723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-4731ec26-39f2-4113-a544-bf859cd060cd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:10.902313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4731ec26-39f2-4113-a544-bf859cd060cd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.530562 Oct 12 12:38:10.904218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 9/16] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:38:10 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:10.950000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-60570d2f-7af3-4e91-a1c2-b47f9778600d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 202 len: 0 microversion: 2.1 time: 0.531128 Oct 12 12:38:10.954539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 8/17] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:38:10 2022] DELETE /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 0 bytes in 536 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:38:10.965575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a6eb734a-8e09-48de-85c6-b2cfd8161949 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f9806198280>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:11.148626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a6eb734a-8e09-48de-85c6-b2cfd8161949 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 200 len: 344 microversion: 2.1 time: 0.193101 Oct 12 12:38:11.149662 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 10/18] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:10 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 344 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:11.666557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d37c61ce-4b36-4523-82af-5773cca042ab tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f98061903a0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:11.730328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d37c61ce-4b36-4523-82af-5773cca042ab tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/66fc9620-6d26-4a44-b8e8-24ba988517aa" status: 200 len: 350 microversion: 2.1 time: 0.067455 Oct 12 12:38:11.731299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 9/19] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:11 2022] GET /compute/v2.1/os-volumes/66fc9620-6d26-4a44-b8e8-24ba988517aa => generated 350 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:11.745424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dd7086ae-5339-4fcc-853e-281771d6ab83 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f9806198ee0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:11.892360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dd7086ae-5339-4fcc-853e-281771d6ab83 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.150451 Oct 12 12:38:11.897987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 11/20] 10.222.0.44 () {58 vars in 1134 bytes} [Wed Oct 12 12:38:11 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:11.911000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5e9ba211-2c30-479f-bd0c-96c0b2fd3de0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f980614d280>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:12.120717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5e9ba211-2c30-479f-bd0c-96c0b2fd3de0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.215206 Oct 12 12:38:12.122149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 12/21] 10.222.0.44 () {58 vars in 1149 bytes} [Wed Oct 12 12:38:11 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:12.134259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b3ca4a26-0579-4c0f-a050-8b1c0a7aa00a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: .version_select at 0x7f980620bdc0>, body: {"keypair": {"name": "tempest-keypair-155442488", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGEk2NtKQn+puyi4kppnyRde00Bdsj2Wr834s8mNbkPCcdE8taXoNWiX7zme+F1rHXpULOf+Vo9W2LnraoiPfLdcnLxXjZTbFLIzusj+O4MbZWScCkoDIyBEKA77Jpb95Q=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:12.136273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-50d47e3c-a5a1-452f-9c94-b66048993bc9 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f9806b77820>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:12.195331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-b3ca4a26-0579-4c0f-a050-8b1c0a7aa00a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for project c056ad05ef9843688f08b7e9f25e1138. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:12.211610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-b3ca4a26-0579-4c0f-a050-8b1c0a7aa00a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for user df8da1fe608d4dd6acb6b7298ca56d45 and project c056ad05ef9843688f08b7e9f25e1138. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:12.269830 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-50d47e3c-a5a1-452f-9c94-b66048993bc9 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.137303 Oct 12 12:38:12.270499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 13/22] 10.222.0.44 () {58 vars in 1134 bytes} [Wed Oct 12 12:38:12 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:12.275271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1e5fe8bc-d50d-473d-b593-2a4c4c30fd29 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f980614d940>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:12.347881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b3ca4a26-0579-4c0f-a050-8b1c0a7aa00a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.479724 Oct 12 12:38:12.359240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 10/23] 10.222.0.44 () {62 vars in 1200 bytes} [Wed Oct 12 12:38:11 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 481 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Oct 12 12:38:12.449798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1518715370", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "networks": [{"uuid": "0019aa52-f1a0-42f2-aeaf-ff7457ad5663"}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:12.470264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1e5fe8bc-d50d-473d-b593-2a4c4c30fd29 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 200 len: 344 microversion: 2.1 time: 0.198315 Oct 12 12:38:12.471405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 14/24] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:12 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 344 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:12.480394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1f1473c5-7098-4def-b5d0-56e401cdb9ac tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f980614df70>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:12.624273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] validate_networks() for [('0019aa52-f1a0-42f2-aeaf-ff7457ad5663', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:38:12.686088 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1f1473c5-7098-4def-b5d0-56e401cdb9ac tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.213333 Oct 12 12:38:12.686864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 15/25] 10.222.0.44 () {58 vars in 1167 bytes} [Wed Oct 12 12:38:12 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:12.703648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2120fe21-75c4-4bba-b226-971b1a7b66ec tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f98061984c0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:12.855138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2120fe21-75c4-4bba-b226-971b1a7b66ec tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.157004 Oct 12 12:38:12.864431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 16/26] 10.222.0.44 () {58 vars in 1170 bytes} [Wed Oct 12 12:38:12 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:12.871217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9177ce38-d66c-4c82-a8d2-6f08c29a88b2 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f9806142280>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:13.150291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9177ce38-d66c-4c82-a8d2-6f08c29a88b2 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.284019 Oct 12 12:38:13.151361 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 17/27] 10.222.0.44 () {58 vars in 1155 bytes} [Wed Oct 12 12:38:12 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:13.164948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1847bd7e-c6d4-4c70-9ce5-a76f225a26d7 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f98061429d0>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:13.315586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1847bd7e-c6d4-4c70-9ce5-a76f225a26d7 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.154615 Oct 12 12:38:13.318462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 18/28] 10.222.0.44 () {58 vars in 1188 bytes} [Wed Oct 12 12:38:13 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:13.332400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-03683f64-9137-49f4-bf69-7b8e3b190aa0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] Calling method '.version_select at 0x7f9806198a60>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:13.565432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-03683f64-9137-49f4-bf69-7b8e3b190aa0 tempest-VolumesTestJSON-142096902 tempest-VolumesTestJSON-142096902-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.238023 Oct 12 12:38:13.566397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 19/29] 10.222.0.44 () {58 vars in 1155 bytes} [Wed Oct 12 12:38:13 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:13.571100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2a300662-53ce-4c1a-b351-91c6b508ef86 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f9806156670>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:13.754074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2a300662-53ce-4c1a-b351-91c6b508ef86 tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 200 len: 344 microversion: 2.1 time: 0.184541 Oct 12 12:38:13.754074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 20/30] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:13 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:14.550856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1844578681", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:14.771922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] validate_networks() for [('1b4ef2f4-49f2-43ce-8f92-68931ce3b901', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:38:14.926415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:38:14.929454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:38:14.930846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:38:14.934305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:38:14.935770 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:38:14.988482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:15.009254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.021s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:15.009665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:15.010560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:15.011028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:15.011459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:15.093038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Getting quotas for project 677a44a0d7bb436f83c23a8e74cffa60. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:15.117039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Getting quotas for user df838ad816744832baa283dabe540394 and project 677a44a0d7bb436f83c23a8e74cffa60. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:15.159619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:38:15.173091 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:38:15.513906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-071fabf1-be84-4d23-9618-3223792349cd tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.117744 Oct 12 12:38:15.513906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 11/31] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:38:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 3119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:38:15.513906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-41db8eee-31c0-4f98-b0b4-f3e90ce86c5d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98060a4dc0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:15.703406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-41db8eee-31c0-4f98-b0b4-f3e90ce86c5d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] HTTP exception thrown: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-41db8eee-31c0-4f98-b0b4-f3e90ce86c5d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Request method failure captured: Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 HTTP/1.1 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUmDznbfDcXI7UgxVhBuKXn3L2o2AxH8gBtkSMap_5PBOP9k9uEDEiCDLIUy706eGJlI9UtKPvHFGbssFT1z6u-zEF5QFqXysuXd6laqZcIkmfZ28NTK9W3s5cHN08WjB7mvPGT7dKd3jgKQ9lAFVxlZ-gVWcjlK4FNLzNHwdfseBY Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:38:15.710616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2a372db0342f425cbd7dedccf68e7fd4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: b65fe96949fe4f87970dc5657b2125f5 Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6'} Oct 12 12:38:15.714959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. (HTTP 404) (Request-ID: req-f051bb46-7d7a-4161-b256-3a0c9b824bb6) Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.715688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:15.716766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 12:38:15.718419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-41db8eee-31c0-4f98-b0b4-f3e90ce86c5d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Returning 404 to user: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-41db8eee-31c0-4f98-b0b4-f3e90ce86c5d tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 404 len: 109 microversion: 2.1 time: 0.237928 Oct 12 12:38:15.719472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 12/32] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:15 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 109 bytes in 240 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:38:15.728279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e50ef3de-32ef-439b-a8ad-109d28f59ea1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:15.729277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e50ef3de-32ef-439b-a8ad-109d28f59ea1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:15.862907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e50ef3de-32ef-439b-a8ad-109d28f59ea1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:15.880429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e50ef3de-32ef-439b-a8ad-109d28f59ea1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1215 microversion: 2.1 time: 0.170108 Oct 12 12:38:15.881595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 13/33] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:15 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1215 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:15.886693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01f64927-10e3-4b3b-908c-f2502d4ac4bd tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f98057f1ee0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:15.931288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-01f64927-10e3-4b3b-908c-f2502d4ac4bd tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] HTTP exception thrown: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01f64927-10e3-4b3b-908c-f2502d4ac4bd tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Request method failure captured: Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: DELETE /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 HTTP/1.1 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUmDznbfDcXI7UgxVhBuKXn3L2o2AxH8gBtkSMap_5PBOP9k9uEDEiCDLIUy706eGJlI9UtKPvHFGbssFT1z6u-zEF5QFqXysuXd6laqZcIkmfZ28NTK9W3s5cHN08WjB7mvPGT7dKd3jgKQ9lAFVxlZ-gVWcjlK4FNLzNHwdfseBY Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:38:15.935705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2a372db0342f425cbd7dedccf68e7fd4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: b65fe96949fe4f87970dc5657b2125f5 Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6'} Oct 12 12:38:15.936924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. (HTTP 404) (Request-ID: req-266736b0-70bf-45a9-8909-eb18bb58bedc) Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.937666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:38:15.938735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 12:38:15.940346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:15.941364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:15.943893 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01f64927-10e3-4b3b-908c-f2502d4ac4bd tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Returning 404 to user: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:38:15.944816 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-01f64927-10e3-4b3b-908c-f2502d4ac4bd tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 404 len: 109 microversion: 2.1 time: 0.061990 Oct 12 12:38:15.945736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 14/34] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:38:15 2022] DELETE /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 109 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:38:15.971459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c8b62cca-f3c3-4369-a625-4ba09ab4295f tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Calling method '.version_select at 0x7f9805804b80>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:16.030527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-c8b62cca-f3c3-4369-a625-4ba09ab4295f tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] HTTP exception thrown: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c8b62cca-f3c3-4369-a625-4ba09ab4295f tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Request method failure captured: Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 HTTP/1.1 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUmDznbfDcXI7UgxVhBuKXn3L2o2AxH8gBtkSMap_5PBOP9k9uEDEiCDLIUy706eGJlI9UtKPvHFGbssFT1z6u-zEF5QFqXysuXd6laqZcIkmfZ28NTK9W3s5cHN08WjB7mvPGT7dKd3jgKQ9lAFVxlZ-gVWcjlK4FNLzNHwdfseBY Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:38:16.034092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/2a372db0342f425cbd7dedccf68e7fd4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_2a372db0342f425cbd7dedccf68e7fd4", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 2a372db0342f425cbd7dedccf68e7fd4 Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1173235951 Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: b65fe96949fe4f87970dc5657b2125f5 Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1173235951-project Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6'} Oct 12 12:38:16.035058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. (HTTP 404) (Request-ID: req-605e66c9-d5fb-420c-ae05-c5ab03ace74e) Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:16.035674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:38:16.036700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 12:38:16.037549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c8b62cca-f3c3-4369-a625-4ba09ab4295f tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] Returning 404 to user: Volume 574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c8b62cca-f3c3-4369-a625-4ba09ab4295f tempest-VolumesSnapshotsTestJSON-1173235951 tempest-VolumesSnapshotsTestJSON-1173235951-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6" status: 404 len: 109 microversion: 2.1 time: 0.084429 Oct 12 12:38:16.038419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 15/35] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:38:15 2022] GET /compute/v2.1/os-volumes/574f35ee-bc7f-48bd-9de8-8bcef1ccf8e6 => generated 109 bytes in 86 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:38:16.908911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ef22eaac-c95a-4078-87fc-3ba2c48cad7e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:16.909531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ef22eaac-c95a-4078-87fc-3ba2c48cad7e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:17.014156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ef22eaac-c95a-4078-87fc-3ba2c48cad7e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:17.028728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ef22eaac-c95a-4078-87fc-3ba2c48cad7e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1215 microversion: 2.1 time: 0.119041 Oct 12 12:38:17.042741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 16/36] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:16 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1215 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:17.083993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1347579490", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f74858ca-46a0-493d-924e-694edecfac99"}], "security_groups": [{"name": "tempest-securitygroup--268230214"}], "key_name": "tempest-keypair-1472153960", "user_data": "}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:17.257034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:38:17.257560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:38:17.257958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:38:17.258600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:38:17.259376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:38:17.276551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:17.277678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:17.278324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:17.279312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:17.280183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:17.280910 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:17.319322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:17.333273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for user 19d863a45ac14c50b940fbc217b70929 and project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:17.376126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:38:17.386862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:38:17.411216 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] validate_networks() for [('f74858ca-46a0-493d-924e-694edecfac99', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:38:17.676988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5582b8f9-c6b7-44c7-b44d-018b3f8833a7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.420659 Oct 12 12:38:17.687095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 21/37] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:38:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 3432 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:38:17.703357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e379a7d7-1c52-4d98-8360-aee8355a37d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:17.704169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e379a7d7-1c52-4d98-8360-aee8355a37d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:17.976199 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e379a7d7-1c52-4d98-8360-aee8355a37d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:18.013433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e379a7d7-1c52-4d98-8360-aee8355a37d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1222 microversion: 2.1 time: 0.323702 Oct 12 12:38:18.017965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 22/38] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:17 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1222 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:18.056772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7a5d50da-0727-41fe-b4a8-58d6558796e8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:18.057554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7a5d50da-0727-41fe-b4a8-58d6558796e8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:18.284953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7a5d50da-0727-41fe-b4a8-58d6558796e8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:18.305196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7a5d50da-0727-41fe-b4a8-58d6558796e8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1215 microversion: 2.1 time: 0.256123 Oct 12 12:38:18.306203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 23/39] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:18 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1215 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:18.321326 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-126045718", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:18.442289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] validate_networks() for [('1b4ef2f4-49f2-43ce-8f92-68931ce3b901', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:38:18.578789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:38:18.580988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:38:18.581743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:38:18.582548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:38:18.583247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:38:18.605084 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:18.606600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:18.607477 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:18.608623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:18.610202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:18.610980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:18.646015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:18.652076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:18.671302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:38:18.677865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:38:19.063425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ae48b0fb-60f4-477d-8152-96a9fd7b9761 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.011216 Oct 12 12:38:19.068360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 17/40] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:38:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 2017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:38:19.099356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-433802866", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a509b816-30d9-40f4-99f7-35e308d0dd5d"}], "security_groups": [{"name": "tempest-securitygroup--2073720925"}], "key_name": "tempest-keypair-155442488", "user_data": "}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:19.408534 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] validate_networks() for [('a509b816-30d9-40f4-99f7-35e308d0dd5d', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:38:19.544634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:38:19.545149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:38:19.546263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:38:19.546263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:38:19.553080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:38:19.577503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:19.583391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:19.583391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:19.586310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:19.589537 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:19.592436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:19.628191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:19.633975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for user 19d863a45ac14c50b940fbc217b70929 and project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:19.653490 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:38:19.656115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:38:19.883035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1b14c391-adeb-4f58-a214-d4c5f8a77b71 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.575143 Oct 12 12:38:19.883703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 24/41] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:38:18 2022] POST /compute/v2.1/servers => generated 383 bytes in 1577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:38:19.902812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6a83b95b-9b9e-4e5e-a9e2-6cdd1e25cbcb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:19.903506 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6a83b95b-9b9e-4e5e-a9e2-6cdd1e25cbcb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:20.015382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6a83b95b-9b9e-4e5e-a9e2-6cdd1e25cbcb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:20.040794 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6a83b95b-9b9e-4e5e-a9e2-6cdd1e25cbcb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1242 microversion: 2.1 time: 0.140165 Oct 12 12:38:20.042154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 25/42] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:19 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1242 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:20.057897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:20.059913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:20.070048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:20.071173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:20.071597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:20.072668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:20.073311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:20.073920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:20.328277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:20.347205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cb37c175-fdc5-4f6a-8c5d-69ff61032185 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1211 microversion: 2.1 time: 0.302133 Oct 12 12:38:20.350948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 26/43] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:20 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1211 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:20.362637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0105b141-7356-4700-89b4-b7a117cd0500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:20.366659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0105b141-7356-4700-89b4-b7a117cd0500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:20.526807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0105b141-7356-4700-89b4-b7a117cd0500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:20.536416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0105b141-7356-4700-89b4-b7a117cd0500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1221 microversion: 2.1 time: 0.180880 Oct 12 12:38:20.539650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 27/44] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:20 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1221 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:20.661498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:38:20.662373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:38:20.663041 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:38:20.664032 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:38:20.664848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:38:20.686476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:20.687116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:20.687672 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:20.691741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:20.692348 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:20.693093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:20.726117 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for project c056ad05ef9843688f08b7e9f25e1138. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:38:20.734652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for user df8da1fe608d4dd6acb6b7298ca56d45 and project c056ad05ef9843688f08b7e9f25e1138. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:38:20.766530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:38:20.771743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:38:20.974081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d197a636-7ce5-4fa7-a74a-fae96f98f0a1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.904387 Oct 12 12:38:20.976754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 18/45] 10.222.0.44 () {62 vars in 1188 bytes} [Wed Oct 12 12:38:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 1908 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 12:38:20.989767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:20.991366 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:21.086289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:21.086289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:21.116953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.125269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.129848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.131588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.134004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.137916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.290700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.307486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.316861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.318713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f26c6ecc-3bb5-476b-a429-b95b9ba827bc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1280 microversion: 2.20 time: 0.334049 Oct 12 12:38:21.325367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 28/46] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:20 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1280 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:21.388569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:21.396970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:21.444884 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.447564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.450723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.455814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.459037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.461158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.663340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.701317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.704765 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3ec9b208-78b2-4303-bf3e-717b9f4f69ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1246 microversion: 2.1 time: 0.627557 Oct 12 12:38:21.719853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-011ced53-792b-4d97-a056-8b345bb5df35 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1275 microversion: 2.1 time: 0.343640 Oct 12 12:38:21.725176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 19/47] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:21 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1246 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:21.726228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 29/48] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:21 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1275 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:21.736080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:21.738231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:21.765481 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.770578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.772536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.773295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:21.774569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:21.777327 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:21.885174 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:21.905796 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e2847507-6c7b-44ce-b852-c08b43a1266a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1225 microversion: 2.1 time: 0.181881 Oct 12 12:38:21.913146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 20/49] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:21 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1225 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:22.354197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:22.354851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:22.480890 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:22.502000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:22.503548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:22.507409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9093bb4f-c75e-480b-ba42-99abb13fc463 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1280 microversion: 2.20 time: 0.157091 Oct 12 12:38:22.511842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 30/50] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:22 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1280 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:22.733268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:22.734572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:22.741473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.741991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.742592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:22.743436 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.743809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.744387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:22.753657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:22.754945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:22.773725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.774423 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.775320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:22.778045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.778998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.779589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:22.910249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:22.923795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-51fa1c8d-85d5-49f4-ac10-0053c3836801 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1273 microversion: 2.1 time: 0.174886 Oct 12 12:38:22.924623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 31/51] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:22 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1273 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:22.934242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:22.943292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:22.945061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:22.945637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9b43a3c3-475d-4648-a890-d7071a6f308a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1294 microversion: 2.1 time: 0.216200 Oct 12 12:38:22.946445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 21/52] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:22 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1294 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:22.973806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.974314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.974665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:22.975381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:22.975841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:22.976639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:23.045896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:23.055444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8b0e3e85-3f49-4512-999c-02ca1cee99b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1217 microversion: 2.1 time: 0.121861 Oct 12 12:38:23.058460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 32/53] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:22 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1217 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:23.542626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:23.543303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:23.559218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:23.560754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:23.562416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:23.563252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:23.582530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:23.583431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:23.949737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:23.950402 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:23.971403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:23.972548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:23.974342 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:23.975373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:23.980133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:23.980979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:24.347927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:24.362932 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:24.364837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:24.371740 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-27a4f532-b172-497a-ba8f-a7411ec953ac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1276 microversion: 2.20 time: 0.841166 Oct 12 12:38:24.378394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 22/54] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:23 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1276 bytes in 849 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:24.386853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:24.396521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:24.414419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:24.426847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:24.427663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:24.428632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:24.429322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:24.429990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:24.718814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:24.729495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4e1f1099-78a5-4145-8c33-81d90d619b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1300 microversion: 2.1 time: 0.349747 Oct 12 12:38:24.747187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 23/55] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:24 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1300 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:24.764684 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:24.765376 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:24.791783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:24.792539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:24.793198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:24.798818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:24.799867 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:24.800455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:25.097783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:25.108278 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-51b8c325-7e46-41ff-9b20-7b571b2f77bc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1273 microversion: 2.1 time: 0.359822 Oct 12 12:38:25.122777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 24/56] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:24 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1273 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:25.288510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:25.300519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0abd3b7e-7765-4013-80ba-2f862d4d11de tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 1.352901 Oct 12 12:38:25.326355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 33/57] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:23 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 1383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:25.415094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:25.415741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:25.430420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:25.434169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:25.437957 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:25.442328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:25.442991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:25.445811 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:25.545723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:25.557407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:25.559096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:25.560360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c9a28e60-5120-4a69-bd74-2d2348b7f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1276 microversion: 2.20 time: 0.149535 Oct 12 12:38:25.561445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 25/58] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:25 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1276 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:25.778924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:25.779634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:25.811873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:25.816394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:25.817005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:25.817990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:25.818449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:25.818930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.050228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:26.062305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0bd4ad7b-e393-44dc-a8aa-c969924e6a63 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1300 microversion: 2.1 time: 0.291063 Oct 12 12:38:26.062797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 34/59] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:25 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1300 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:26.149944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:26.150574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:26.161218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.163940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.163940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.163940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.163940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.164317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.327436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:26.329088 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:26.340209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.342255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.342255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.342255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.342494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.342719 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.381436 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:26.394931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b9a36a7e-390a-4927-9213-923cc12bc500 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1273 microversion: 2.1 time: 0.249380 Oct 12 12:38:26.420831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 26/60] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:26 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1273 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:26.588882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:26.590545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:26.614185 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.614946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.624739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.634808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:26.636410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:26.636928 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:26.919983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:26.934355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:26.943057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:26.946652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e7175239-e7de-4757-9d4b-dac47a85bbaf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1332 microversion: 2.20 time: 0.361832 Oct 12 12:38:26.966892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 27/61] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:26 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1332 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:27.089062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:27.089696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:27.105549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:27.106424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:27.106424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:27.106424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:27.106424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:27.107373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:27.107373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:27.109800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7c15139a-2918-44c8-84ce-b7bbccce360b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.786569 Oct 12 12:38:27.111030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 35/62] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:26 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:27.419928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:27.420659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:27.434875 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:27.439039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:27.439590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:27.442210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:27.442941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:27.449608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:27.643509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:27.656668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-21af41ab-059c-4b3e-837d-5a4aa1f5a11e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1279 microversion: 2.1 time: 0.236738 Oct 12 12:38:27.657857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 36/63] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:27 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1279 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:27.980721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:27.981652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:27.994102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:27.998195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:27.998974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:27.999899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:28.000358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:28.001093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:28.344077 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:28.367814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:28.374708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:28.382774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:28.402138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c5d62dae-28d5-4dc2-8be0-ca15197f9715 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 1.316740 Oct 12 12:38:28.405812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-46e091f3-a3db-4581-a330-0a4e11e8f532 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1340 microversion: 2.20 time: 0.428861 Oct 12 12:38:28.406455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 37/64] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:27 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1340 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:28.418239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 28/65] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:27 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:28.427851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:28.430221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:28.463510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:28.464457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:28.465414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:28.469986 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:28.472252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:28.473256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:28.691163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:28.693231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:28.707485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:28.713336 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:28.717001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:28.718187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:28.718983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:28.721388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:28.948996 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:28.977843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3d101683-d3d0-41b6-8b41-4343ac5f3eb3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1279 microversion: 2.1 time: 0.298078 Oct 12 12:38:28.980082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 29/66] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:28 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1279 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:29.436547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:29.443833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:29.467384 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:29.468122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:29.468709 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:29.469560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:29.470547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:29.471870 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:29.616195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=4 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:30.391206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:30.405284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b8c75775-5141-4a44-a5d3-2066874b0183 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 1.983142 Oct 12 12:38:30.410569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 38/67] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:28 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 1994 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:30.415425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:30.416035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:30.463213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:30.463213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:30.463213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:30.463213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:30.463616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:30.463616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:30.715664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:30.747523 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=26 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:30.759274 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:30.768873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f9afb3b1-147a-4bb8-a861-79ac641fd187 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 1.344725 Oct 12 12:38:30.789545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 30/68] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:29 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 1351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:30.789545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:30.789545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:30.789545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:30.789947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:30.789947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:30.789947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:30.800422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:30.801357 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:30.880870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:30.890100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:30.892098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:30.950383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ded33cc6-e3b1-4ce5-9365-0ef1c6a3b03f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1338 microversion: 2.20 time: 0.482323 Oct 12 12:38:30.951046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 39/69] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:30 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1338 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:31.368667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6badf94a-7a18-401e-b206-66515f3231f8", "tag": "b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:31.410334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.411495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.412248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.449486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Creating event network-changed:b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b for instance 6badf94a-7a18-401e-b206-66515f3231f8 on hv-cinder-81268 Oct 12 12:38:31.450997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 12:38:31.451887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-402ddf91-f6a5-45ff-9042-65f6bb3835b5 req-8bd8f232-db81-430b-a6e5-79dd10e60234 service nova] Acquired lock "compute-rpcapi-router" {{(pid=130867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 12:38:31.453288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.453898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.454507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.470631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.471195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.471632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.486110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.compute.rpcapi [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 12:38:31.487508 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] Releasing lock "compute-rpcapi-router" {{(pid=130867) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 12:38:31.514066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3248db6a-380f-4a2a-8171-55e87d1f2a75 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.474382 Oct 12 12:38:31.515363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 40/70] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:31.538032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:31.538032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:31.557566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.558881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.560987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.565892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.569962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:31.580161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.581194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.581596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ead67538-6b72-4f46-9c22-c90c5ea32a7f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.803931 Oct 12 12:38:31.588728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 31/71] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:30 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:31.811676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:31.811676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:31.835590 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:31.838964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.840577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.840577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:31.841637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:31.842347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:31.843019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:32.493896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=28 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:32.543455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:32.551058 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ecc47b3e-c40e-4d15-a478-cdc401327c90 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 1.031814 Oct 12 12:38:32.551711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 41/72] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:31 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:32.583492 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:32.587962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:32.638847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:32.639344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:32.649326 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:32.655126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:32.655619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:32.659455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:32.659577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:32.668417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-678d5130-de1f-4a30-9edf-ccd33b7f6412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.865685 Oct 12 12:38:32.669075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 32/73] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:31 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 869 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:32.681495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:32.704575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:32.729609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:32.734992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:32.738516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:32.745295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:32.747449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:32.747449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:32.954465 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:32.989999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:32.989999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:32.989999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-892f6396-6ce9-4f2b-80a1-43b11b5c1487 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1338 microversion: 2.20 time: 0.411233 Oct 12 12:38:32.990771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 42/74] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:32 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1338 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:33.231693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:33.243076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-55d38fe8-1702-4fd5-880f-ac20f5f3f07b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.570229 Oct 12 12:38:33.248472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 33/75] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:32 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:33.586748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:33.587960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:33.600914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.603275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.605269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.606514 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.607329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.610702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.686813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9a56b7b4-f127-4adf-bf73-a699108a7a11", "tag": "72e52c23-5517-41fd-8ed1-dd798c7bba3a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:33.715388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.717073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.717073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.741630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Creating event network-changed:72e52c23-5517-41fd-8ed1-dd798c7bba3a for instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 on hv-cinder-81268 Oct 12 12:38:33.742679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=130866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Oct 12 12:38:33.743295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6bc098b4-62a9-479a-bd1c-1aa31ea96feb req-bd4db211-26b3-43c1-8f17-22597961c80e service nova] Acquired lock "compute-rpcapi-router" {{(pid=130866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Oct 12 12:38:33.744581 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.745405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.746147 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.747180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.748858 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.749616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.758776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:33.763353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.compute.rpcapi [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Oct 12 12:38:33.764588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] Releasing lock "compute-rpcapi-router" {{(pid=130866) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Oct 12 12:38:33.783901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c3276d85-42d5-485f-accf-50fdf1b2efd6 None None] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101720 Oct 12 12:38:33.785294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 34/76] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:33.792183 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:33.793145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:33.800474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.801364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.802060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.802985 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:33.803598 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:33.804303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:33.995848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:34.004705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-faf56c0f-1b1f-4436-98f2-8ec91288ec25 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.217617 Oct 12 12:38:34.012322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 35/77] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:33 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:34.023197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:34.024004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:34.040864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:34.041859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:34.042480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:34.043401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:34.048837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:34.048837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:34.250788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:34.271418 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:34.280446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:34.280446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0451ad28-2805-4a73-8960-39932362fd46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1338 microversion: 2.20 time: 0.259438 Oct 12 12:38:34.280446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 36/78] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:34 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1338 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:34.300751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:34.308426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:34.318294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:34.320467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:34.320915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:34.321714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:34.322201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:34.322681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:34.670034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:34.676571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e69eea0a-b93d-4cba-849b-39ea13a7c12c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.399407 Oct 12 12:38:34.682459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 37/79] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:34 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:34.939065 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eb4f3-2765-48cc-9bee-2178c185deca", "tag": "774032af-94ee-4d83-8d1a-09707f3d7c09"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:34.952858 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:34.958774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:34.959490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:34.990657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] Creating event network-changed:774032af-94ee-4d83-8d1a-09707f3d7c09 for instance 283eb4f3-2765-48cc-9bee-2178c185deca on hv-cinder-81268 Oct 12 12:38:34.999692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-e3c8fc6f-6880-4333-bf6a-dd6214a958be req-d1222c66-5d12-43c3-b5c7-9d5b84d817ab service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.315854 Oct 12 12:38:35.000402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 38/80] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:35.040990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:35.043692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:35.049009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.050098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.050764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.051654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.052320 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.054461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.068031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:35.094042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f9a4527f-1dae-4b70-b90a-2bd479cfe8ea tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 1.509424 Oct 12 12:38:35.105136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 43/81] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:33 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 1520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:35.303271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:35.306127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:35.317048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:35.324535 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.325043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.325486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.330780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.331265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.331711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.734987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:35.744446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-56511f9e-4ece-4c2a-92f6-a4c6c7c925be tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.711366 Oct 12 12:38:35.757758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 39/82] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:35 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:35.768609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:35.771038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:35.780197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.781493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.781953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.782691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:35.783142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:35.783602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:35.969403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:35.978817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:35.980740 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:35.981382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-01544b4a-215c-4d03-b6c3-811335ff66b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.683400 Oct 12 12:38:35.984266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 44/83] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:35 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:36.120054 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:36.121326 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:36.137439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:36.137741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:36.138369 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:36.139384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:36.140137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:36.140578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:36.149874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:36.157207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:36.157600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-425c48e8-8c3b-4340-b3d9-b944bded2f7c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.398644 Oct 12 12:38:36.163021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 40/84] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:35 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:36.392380 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:36.400448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-28014c26-fa76-4e7f-9079-3e6291877aad tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.284686 Oct 12 12:38:36.401255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 45/85] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:36 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:36.771630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:36.772649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:36.779609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:36.781958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:36.781958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:36.781958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:36.781958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:36.782479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:36.911901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:36.920421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6eb31383-e0e8-4e8d-9ba5-ca923648afe9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.152316 Oct 12 12:38:36.921151 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 41/86] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:36 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:37.009089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:37.009698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:37.016066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.016547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.016978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.018265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.018621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.019040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.031656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "11e5f782-870a-40d7-a8ff-1a10204d7a88", "tag": "c71a3103-728d-4917-bb33-d259926bb1a1"}, {"name": "network-changed", "server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:37.043918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.044411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.045122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.058132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Creating event network-changed:c71a3103-728d-4917-bb33-d259926bb1a1 for instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 on hv-cinder-81268 Oct 12 12:38:37.058869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] Creating event network-changed:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:38:37.066425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-a6089a98-f6f6-4277-9e4a-badc253619a9 req-db170f7a-43c5-4812-9afc-113786a76bb5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.039653 Oct 12 12:38:37.067327 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 42/87] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:37 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:37.161863 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:37.170208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:37.171645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:37.172819 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-03e3bccb-8648-4081-883d-dd0e97eb02da tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.167798 Oct 12 12:38:37.173372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 46/88] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:37 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:37.196113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:37.196113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:37.198106 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.198755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.199278 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.200035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.200548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.201030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.380885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:37.388465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f12d85a4-c305-4b15-b68c-b890ae9e5972 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.202358 Oct 12 12:38:37.389052 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 43/89] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:37 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:37.424486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:37.425247 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:37.434081 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.434081 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.434081 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.436306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.436974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.437732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.590264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:37.600371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-02753f59-f495-458e-9de8-ff56bf6e641f tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.177713 Oct 12 12:38:37.600371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 47/90] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:37 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:37.943669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:37.944804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:37.950776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.951260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.957125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:37.957125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:37.957125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:37.957125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.088107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.096565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b076f34d-b088-46f2-a0cf-e5d83d116a94 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.156775 Oct 12 12:38:38.097341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 44/91] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:37 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:38.198649 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:38.199343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:38.205307 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.206420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.206917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.207664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.208178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.208661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.414690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:38.416168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:38.431504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.432073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.432595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.433397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.433909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.434561 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.519792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.536558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.538304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.541460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-847c5106-4447-4c5f-8dea-0a81480a26e2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.346094 Oct 12 12:38:38.546352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 48/92] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:38 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:38.622123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:38.623093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:38.634613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.635457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.637344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.638332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:38.640631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:38.641348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:38.649919 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.657792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5a9b39fa-4a25-4e6b-9917-af6e0cc26f38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.249293 Oct 12 12:38:38.658428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 45/93] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:38 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:38.829518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:38.843439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-255595f5-624f-4aa5-803e-c01d732c29fe tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.221506 Oct 12 12:38:38.843439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 49/94] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:38 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:39.123071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:39.124365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:39.133240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.134282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.141592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.141592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.141592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.141592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.327447 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:39.336273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-264fc066-2184-4365-8df7-593e8696c167 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.217865 Oct 12 12:38:39.337486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 46/95] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:39 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:39.570421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:39.571234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:39.582163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.584069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.585666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.587101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.588753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.590024 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.685282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:39.686385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:39.721398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.730615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.731146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.734404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.735068 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.736587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.837080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:39.853632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:39.855194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:39.856324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7d0143ef-52ca-43ae-bd41-39bc64893e27 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.292588 Oct 12 12:38:39.873964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 50/96] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:39 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:39.880402 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:39.882433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:39.893612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.893612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.894108 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:39.896151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:39.896625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:39.897060 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:40.024682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:40.032451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4d46380b-6d4e-46f3-9310-2abf71633829 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.351341 Oct 12 12:38:40.033023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 47/97] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:39 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:40.102123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:40.109956 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ca2dca80-45af-42d4-8b10-cda9ee99447e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.242434 Oct 12 12:38:40.110521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 51/98] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:39 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:40.361875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:40.362550 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:40.369190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:40.373791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:40.373791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:40.373791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:40.373791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:40.374465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:40.504017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:40.517288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e648e907-2c97-4883-b6f3-311f65f3ac36 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.158617 Oct 12 12:38:40.518466 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 48/99] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:40 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:40.884606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:40.885217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:40.891705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:40.892179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:40.896056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:40.898245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:40.898755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:40.899198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.065209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.071987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:41.071987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:41.076845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.077737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.078497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.078816 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.079596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.081165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.082172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.083563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.083920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-01145c66-f269-44b7-b7e8-40bd553959b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.200904 Oct 12 12:38:41.084608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 52/100] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:40 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:41.132796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:41.133513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:41.139643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.140390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.140897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.141670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.142364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.143035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.232595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.241227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-42092f22-bb82-4b23-b855-1c9361d179a3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.188706 Oct 12 12:38:41.242055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 49/101] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:41 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:41.272804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.280454 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f1090bca-086c-4d1c-9410-3bcb7a5b5dd7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.151664 Oct 12 12:38:41.281014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 53/102] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:41 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:41.540874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:41.541510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:41.547405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.547882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.548308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.548995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:41.549485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:41.549903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:41.682510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:41.691933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1f94a6be-0c05-4994-88c4-2c8b985ed4ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.154963 Oct 12 12:38:41.699827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 50/103] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:41 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:42.118717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:42.119462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:42.125822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:42.131426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.132115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.132647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.133357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.134573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.135944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.272663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:42.274211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:42.285351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.290053 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.291579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.292424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.293648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.294990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.504447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:42.520639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:42.522344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:42.523618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ebbc809b-aef8-47d6-a259-93d90e92678a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.412750 Oct 12 12:38:42.538362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 54/104] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:42 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:42.555729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:42.556982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:42.569652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.572489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.573126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.574151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.575856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.576446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.928847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:42.938758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-316288e6-95e0-4b85-91da-cec83bd9532e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.678133 Oct 12 12:38:42.943178 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 51/105] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:42 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:42.945430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:42.946227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:42.952698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.953183 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.953617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:42.954347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:42.954805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:42.955252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:43.262519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:43.275299 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d8ebe62a-ddaa-4c9b-8c74-064e651f2220 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.725640 Oct 12 12:38:43.276165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 55/106] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:42 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 737 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:43.562974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:43.564227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:43.568449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:43.578946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:43.580481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:43.580941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:43.582427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:43.583746 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:43.584365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:43.586596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:43.607368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-aa434c99-9f1a-4099-b638-bd0e1dd0209f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.663899 Oct 12 12:38:43.624745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 52/107] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:42 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:43.930177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:43.947966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:43.949692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:43.951472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2cff01e8-7fdc-41bb-abcb-109439131eb5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.399580 Oct 12 12:38:43.953001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 56/108] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:43 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:43.969170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:43.969170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:43.969170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:43.972030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:43.972620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:43.973160 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:43.973910 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:43.974793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:43.974793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:44.155036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:44.166357 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d36672c6-8eb0-43c6-b1bc-6a13174e89d2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.206187 Oct 12 12:38:44.169439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 53/109] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:43 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:44.301254 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:44.302571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:44.311338 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:44.312728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:44.313783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:44.315310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:44.315989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:44.316662 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:44.505777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:44.513474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2ecd39ce-2653-464c-b3f8-ca86a7219300 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.216734 Oct 12 12:38:44.514085 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 57/110] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:44 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:44.632286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:44.633287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:44.639586 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:44.640600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:44.641238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:44.642396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:44.643794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:44.644418 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:44.841960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:44.851663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9f3224ae-a008-4878-b713-d5f88d95bce9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.223925 Oct 12 12:38:44.852792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 54/111] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:44 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:44.983642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:44.984876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:44.999095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:44.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.001588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.006917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.007556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.010407 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.191577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:45.192358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:45.201485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.203024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.208558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.208558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.208558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.208558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.244511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:45.258071 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:45.260628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:45.262633 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f3bb0515-8256-4b7d-9c6c-d8510b7457ed tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.284436 Oct 12 12:38:45.263931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 58/112] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:44 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:45.366716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:45.374403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e78cba57-a43a-4d83-aa49-9417552b8c86 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.187139 Oct 12 12:38:45.374972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 55/113] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:45 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:45.538329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:45.540211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:45.551681 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.553084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.553528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.554255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.557004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.560404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.854982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:45.864648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-96561d1d-06a6-4768-a66f-2fc7e95b3ae8 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.330497 Oct 12 12:38:45.867895 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 59/114] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:45 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:45.889512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:45.890354 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:45.902067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.902734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.904952 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:45.905825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:45.906333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:45.906750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.112281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:46.120556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4a7dbbfc-f479-4bea-ad7e-484d62f7affc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.237461 Oct 12 12:38:46.122420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 56/115] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:45 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:46.227664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6badf94a-7a18-401e-b206-66515f3231f8", "name": "network-vif-plugged", "status": "completed", "tag": "b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:46.243218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.243709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.244148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.284047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] Creating event network-vif-plugged:b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b for instance 6badf94a-7a18-401e-b206-66515f3231f8 on hv-cinder-81268 Oct 12 12:38:46.289178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-f1f91130-7ebc-4b94-b0dd-121eaa1852e4 req-d05531c1-95c4-460c-8f32-0dc910d16a40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.302110 Oct 12 12:38:46.290037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 60/116] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:46.293209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:46.294092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:46.305326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.305831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.306520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.307231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.307691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.308110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.398455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:46.399217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:46.405815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.406385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.406818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.407690 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.408304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.409244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.527549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:46.543091 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:46.555122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:46.556564 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f283f697-7e59-4272-8d9e-37dfd0c5a969 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.271005 Oct 12 12:38:46.564870 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 57/117] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:46 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:46.676955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:46.703862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a8a90ce1-ed20-4cc9-974f-4a0da5021b3b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.293952 Oct 12 12:38:46.703862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 61/118] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:46 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:46.900575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:46.903175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:46.917894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.919920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.920432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:46.921161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:46.921635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:46.922086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.148170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:47.148806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:47.158915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.159426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.162638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.163387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.166748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.167409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.198877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.208837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f3234fb8-df59-4f5b-88b9-c5cf32dba70e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.316640 Oct 12 12:38:47.213412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 58/119] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:46 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:47.223292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:47.425581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.434423 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0d2e54a9-1449-4f3f-aa8e-1d0548ceb55f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.291549 Oct 12 12:38:47.438705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 62/120] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:47 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:47.580951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:47.581564 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:47.591680 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.594558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.595270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.596276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.596837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.597325 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.715174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:47.716378 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:47.726771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.728657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.729317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.730448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:47.731226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:47.732044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:47.812244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.818473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.820471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.822078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-df2be14e-ea6c-4819-bf31-3e4ea4822ce4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.245097 Oct 12 12:38:47.823133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 59/121] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:47.928075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:47.936308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9d351f5f-c0c8-4e82-b79f-24574fe48981 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.226789 Oct 12 12:38:47.936898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 63/122] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:47 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:48.232875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:48.233618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:48.239644 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.240131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.240566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.241510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.241984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.242748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.430364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:48.439756 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-82f492bb-3f01-4736-bc78-dc74c07c3392 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.210781 Oct 12 12:38:48.440995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 60/123] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:48 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:48.466574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:48.467549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:48.474536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283eb4f3-2765-48cc-9bee-2178c185deca", "name": "network-vif-plugged", "status": "completed", "tag": "774032af-94ee-4d83-8d1a-09707f3d7c09"}, {"server_uuid": "9a56b7b4-f127-4adf-bf73-a699108a7a11", "name": "network-vif-plugged", "status": "completed", "tag": "72e52c23-5517-41fd-8ed1-dd798c7bba3a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:48.476733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.477406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.478018 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.478925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.479519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.480265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.493848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.497607 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.498149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.527412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Creating event network-vif-plugged:774032af-94ee-4d83-8d1a-09707f3d7c09 for instance 283eb4f3-2765-48cc-9bee-2178c185deca on hv-cinder-81268 Oct 12 12:38:48.528256 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] Creating event network-vif-plugged:72e52c23-5517-41fd-8ed1-dd798c7bba3a for instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 on hv-cinder-81268 Oct 12 12:38:48.536733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-27096da9-be20-4034-8c89-4089c6478b1a req-362da8be-78b6-4f10-a924-1efcde8b42f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067424 Oct 12 12:38:48.540179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 61/124] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:48 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:48.650383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:48.661514 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-875adae8-61bb-4de2-b39f-6e0cc1d92dc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.205481 Oct 12 12:38:48.678003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 64/125] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:48 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:48.848993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:48.849685 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:48.856040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.858468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.858468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.858468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.858468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.858837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.959618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:48.960224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:48.973048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.976776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.977292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:48.978144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:48.978787 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:48.979423 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:49.008855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.017495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.020181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.021401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0f220874-90a5-40ab-a9f5-b43c633d2919 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.177178 Oct 12 12:38:49.022289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 62/126] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:48 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:49.235756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.244768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-125b29b7-a6fc-4e6b-a4f0-742e28fa98ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.289483 Oct 12 12:38:49.245501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 65/127] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:48 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:49.468193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:49.469083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:49.479330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:49.480074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:49.481219 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:49.482526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:49.487629 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:49.487629 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:49.685111 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:49.685729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:49.693573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:49.694142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:49.694641 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:49.695501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:49.695967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:49.696389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:49.699628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.709045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8b5dae89-cfce-46c6-b956-87dd64040d0b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1315 microversion: 2.1 time: 0.246730 Oct 12 12:38:49.710232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 63/128] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:49 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1315 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:49.925664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:49.931395 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5792b45e-221c-46a8-94ce-f0dc91bca100 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.249928 Oct 12 12:38:49.932079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 66/129] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:49 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:50.048049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:50.049811 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:50.057403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.058296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.059197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.060253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.060981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.061802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.229845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:50.238432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:50.239865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:50.241314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7f58ce49-0e25-4226-a201-aaec5ad1303f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.197748 Oct 12 12:38:50.242061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 64/130] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:50 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:50.269878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:50.271084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:50.278046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.278522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.279813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.280627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.281293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.281711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.490308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:50.500456 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b3f51b94-9298-461f-8c5d-cc54f069eb23 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.234938 Oct 12 12:38:50.500760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 67/131] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:50 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:50.589616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "name": "network-vif-plugged", "status": "completed", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:50.601621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.607962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.607962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.615987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] Creating event network-vif-plugged:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:38:50.620981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-2d321521-af81-4f77-a1a9-967815fdb008 req-14a5aaab-2483-44ea-9f5f-adf6071f5d8d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036455 Oct 12 12:38:50.621585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 65/132] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:50.733127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:50.733737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:50.740599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.741706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.742193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.742868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.743320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.743787 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.882272 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:50.890163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-df7dc7ac-a605-4f95-a4a2-b27ed2b19563 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1501 microversion: 2.1 time: 0.161006 Oct 12 12:38:50.890729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 68/133] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:50 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1501 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:50.954922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:50.955897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:50.962418 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.962913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.963332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:50.964018 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:50.964467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:50.964885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:51.138907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:51.148014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5682f77c-99f2-4620-9481-50fbb6139e04 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1367 microversion: 2.1 time: 0.197220 Oct 12 12:38:51.159051 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 66/134] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:50 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:51.269522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:51.271123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:51.277819 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:51.278464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:51.279150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:51.280397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:51.280988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:51.281510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:51.515539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:51.524281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:51.524882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:51.531186 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:51.531673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:51.532270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:51.532766 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:51.532889 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:51.533246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:51.533700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:51.534266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:51.535354 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-32742504-9dc0-483d-80be-aeb2c7b4ee3f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.272442 Oct 12 12:38:51.535908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 69/135] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:51 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:51.685907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:51.694692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4b38ee79-af67-4060-aa93-f20d370fa334 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.174293 Oct 12 12:38:51.706562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 67/136] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:51 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:38:52.181625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:52.182288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:52.188151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.188625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.189048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.189731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.190191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.190605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.326854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:52.335914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5cf0dfa0-c71a-4d4e-9003-2c523f7c4168 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1557 microversion: 2.1 time: 0.157952 Oct 12 12:38:52.336888 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 70/137] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:52 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:52.361744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:52.362257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:52.368323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.368801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.369226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.369959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.370406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.370821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.508981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-854641ba-efc5-497e-8129-58180d8a8c23 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151352 Oct 12 12:38:52.509841 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 68/138] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:38:52 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:52.559988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:52.560532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:52.573651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.575315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.575968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.578693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.579323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.580093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.636694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e5f782-870a-40d7-a8ff-1a10204d7a88", "name": "network-vif-plugged", "status": "completed", "tag": "c71a3103-728d-4917-bb33-d259926bb1a1"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:52.658369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.658369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.658369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.661545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] Creating event network-vif-plugged:c71a3103-728d-4917-bb33-d259926bb1a1 for instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 on hv-cinder-81268 Oct 12 12:38:52.666848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-6989f20a-94a4-4398-936b-2fc42bf3000b req-7a2faaac-d5c4-4ef2-a55b-d14f162018fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033874 Oct 12 12:38:52.667514 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 69/139] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:38:52.727196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:52.727958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:52.739006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.741522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.742773 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.743521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.744044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.746562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.808801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:52.818750 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:52.823687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:52.827113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f8d85054-816a-4832-9cf2-0c012033413b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.271044 Oct 12 12:38:52.831063 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 71/140] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:52 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:52.980975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eb9c3bac-7956-4cad-8fca-1a7bfef91ade"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:52.980975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:52.985524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.986038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.986470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:52.987739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:52.988186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:52.988614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:53.068854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:53.079601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-beb565c8-35a0-442e-9247-a97629ec3f18 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.363921 Oct 12 12:38:53.080189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 70/141] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:52 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:53.857003 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:53.859169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:53.866763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:53.869184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:53.869184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:53.869184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:53.869664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:53.870572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:54.127499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:54.131168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:38:54.136989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:54.138502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:54.139693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-370b2eec-da3e-4608-8a08-1d5d7173c2a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1406 microversion: 2.20 time: 0.290216 Oct 12 12:38:54.140323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 71/142] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:53 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1406 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:38:54.146267 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:54.146934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:54.153426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:54.154327 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:54.154763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:54.156131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:54.156900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:54.159120 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:54.352527 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-94c2a1ee-73f9-44df-babb-43ad8e56920d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "POST /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.379241 Oct 12 12:38:54.354355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 72/143] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:38:52 2022] POST /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8/os-volume_attachments => generated 194 bytes in 1382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:54.478657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:54.488611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c0078d9d-97e2-421d-8b86-ce7f97f09578 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.347050 Oct 12 12:38:54.497388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "283eb4f3-2765-48cc-9bee-2178c185deca", "tag": "774032af-94ee-4d83-8d1a-09707f3d7c09"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:54.502060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 72/144] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:54 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:54.517261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:54.520258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:54.521108 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:54.534745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] Creating event network-changed:774032af-94ee-4d83-8d1a-09707f3d7c09 for instance 283eb4f3-2765-48cc-9bee-2178c185deca on hv-cinder-81268 Oct 12 12:38:54.540992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-6ae82a21-e068-4a3c-83d6-84d2368d118b req-f0818828-5531-4c0f-921c-3baea8d77aff service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051095 Oct 12 12:38:54.541802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 73/145] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:55.168884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:55.170292 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:55.179088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.179088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.179557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.180368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.180908 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.181819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.316661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:55.325630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:55.327423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:55.334332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cea95840-a263-4c01-9c21-02053c17b022 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1598 microversion: 2.20 time: 0.164666 Oct 12 12:38:55.334332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 73/146] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:38:55 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1598 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:38:55.356994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:55.359982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:55.371546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.372051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.372464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.373376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.373827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.374284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.515157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:55.516259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:55.517131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-051256bd-80ab-4512-8271-91f108ce6492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.165442 Oct 12 12:38:55.525268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 74/147] 10.222.0.44 () {60 vars in 1316 bytes} [Wed Oct 12 12:38:55 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-interface => generated 284 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:38:55.537922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.538810 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.539535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.540341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:55.541531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:55.542060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:55.816228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:55.833556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7c20c334-3111-4644-b303-e335e3974abc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1321 microversion: 2.1 time: 0.323459 Oct 12 12:38:55.839502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 74/148] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:55 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1321 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:56.863029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:56.863638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:56.870622 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:56.871551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:56.872323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:56.874573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:56.875667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:56.876394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.094730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:57.114339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-87d7b785-69a5-4508-94df-7ff72bfe1037 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1516 microversion: 2.1 time: 0.246269 Oct 12 12:38:57.114339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 75/149] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:56 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1516 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:57.130410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:57.133032 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:57.139576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:57.140420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:57.141110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.142195 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:57.143314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:57.143815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.176137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'flavor' on Instance uuid 11e5f782-870a-40d7-a8ff-1a10204d7a88 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:38:57.281784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:38:57.292073 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:57.292554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:57.292984 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.303679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] Creating event network-changed:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:38:57.308566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-1e1a06a5-c596-4746-a42a-ef5216c3e99a req-a084c06b-dc4f-419f-b9a8-5e4501eb88c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032159 Oct 12 12:38:57.309143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 76/150] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:38:57.540306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e8ee3cba-4042-469e-81ed-8f39862c87fa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88/action" status: 200 len: 32 microversion: 2.1 time: 0.415119 Oct 12 12:38:57.541675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 75/151] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:38:57 2022] POST /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88/action => generated 32 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:38:57.552499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:57.553409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:57.560325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:57.561084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:57.561618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.562419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:57.562997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:57.563486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:57.821376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:57.832109 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d1a323d7-4ffe-43bd-8551-48bcb6e0266f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.284564 Oct 12 12:38:57.838247 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 77/152] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:57 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:38:58.859144 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:38:58.859848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:38:58.866716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:58.867255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:58.867694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:58.868385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:38:58.868942 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:38:58.869654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:38:59.009595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:38:59.019020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-568c2e7d-66da-4a2e-b677-730b51105a90 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.163673 Oct 12 12:38:59.024309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 76/153] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:38:58 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:00.045703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:00.047920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:00.053671 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:00.054175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:00.054604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:00.055332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:00.055845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:00.056504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:00.194972 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:00.200982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5ae75f1e-af69-4eda-9321-2e12d4304e95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.159287 Oct 12 12:39:00.201546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 78/154] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:00 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:01.224549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:01.225241 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:01.231650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:01.232210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:01.232901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:01.234083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:01.234692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:01.235213 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:01.390358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:01.398341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6d4dcd4a-9c9b-4603-b506-789dd3028d7e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.177674 Oct 12 12:39:01.398933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 77/155] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:01 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:02.420448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:02.421057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:02.428014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:02.428525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:02.428961 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:02.429646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:02.430148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:02.430566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:02.449001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:02.585728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:02.593490 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b9a7fca8-78cc-4dcd-bf9c-7bf324bf0154 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.176819 Oct 12 12:39:02.594067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 79/156] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:02 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:03.617706 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:03.618347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:03.624667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:03.625150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:03.625611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:03.626316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:03.626920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:03.627522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:03.851223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:03.851223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-391e2556-a70b-4f15-a515-7e2dfec6e24a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.151824 Oct 12 12:39:03.851223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 78/157] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:03 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:04.844606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:04.845210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:04.852996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:04.853816 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:04.854275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:04.854959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:04.855404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:04.855819 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:04.993546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:05.002945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8459b3f3-8f02-4122-b485-b437edc660ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.161601 Oct 12 12:39:05.003701 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 80/158] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:04 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:06.025524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:06.026163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:06.028213 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=93 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:06.032956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:06.033440 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:06.033897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:06.034615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:06.035064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:06.035531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:06.169068 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:06.177443 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-046aa2e1-1225-4afe-ae89-b3d7bdcbd2fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.155808 Oct 12 12:39:06.178031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 79/159] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:06 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:07.200564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:07.201238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:07.204101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=73 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:07.209802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:07.210320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:07.210753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:07.211534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:07.211999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:07.212463 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:07.342099 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:07.349922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2474c4c0-1d6f-40a3-a1ff-27c0416bd314 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.153267 Oct 12 12:39:07.350519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 81/160] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:07 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:08.373652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:08.374792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:08.381630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:08.382157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:08.382588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:08.383332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:08.383839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:08.384261 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:08.530337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:08.539295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6400eeef-6703-4b40-b71d-f797d433402b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.169930 Oct 12 12:39:08.543814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 80/161] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:08 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:09.564529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:09.565165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:09.571853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:09.572335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:09.579374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:09.579374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:09.579374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:09.579374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:09.718850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:09.719457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:09.727468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:09.728069 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:09.728627 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:09.729426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:09.729853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:09.730395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:09.731037 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:09.739965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b3e34988-61a5-4cc1-9cae-c727cd6a9ee2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.179171 Oct 12 12:39:09.740844 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 82/162] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:09 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:09.761617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:39:10.118897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1a506147-dc11-47fc-8d3c-7e0e4c1c325d tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 204 len: 0 microversion: 2.1 time: 0.404184 Oct 12 12:39:10.119495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 81/163] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:39:09 2022] DELETE /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 12:39:10.127978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:10.128623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:10.134428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:10.134927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:10.135694 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:10.136069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:10.136845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:10.137273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:10.291823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:10.304664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c3f89c51-3c02-4e01-8d60-2e062ba9742e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1553 microversion: 2.1 time: 0.180452 Oct 12 12:39:10.305597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 83/164] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:10 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1553 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:10.764717 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:10.766014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:10.772243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:10.773017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:10.773616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:10.774540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:10.775190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:10.775803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:10.925859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:10.933489 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-adfa9fae-bd3c-46ec-b7d7-3e65f46972ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.173181 Oct 12 12:39:10.934120 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 82/165] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:10 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:11.328732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:11.337212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:11.339067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:11.341264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:11.341717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:11.342518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:11.342912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:11.343338 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:11.532833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:11.544202 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e30014a1-adfe-4218-8f14-08386a1d2dae tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1553 microversion: 2.1 time: 0.219198 Oct 12 12:39:11.547608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 84/166] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:11 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1553 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:11.960768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:11.961901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:11.968252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:11.968885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:11.969464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:11.970453 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:11.971008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:11.971584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:12.111875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:12.123339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9c33dbe7-c1b6-4aa7-84ba-451ce80098d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.166473 Oct 12 12:39:12.124119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 83/167] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:11 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:12.568664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:12.569192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:12.575584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:12.576063 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:12.576621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:12.577298 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:12.577861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:12.578303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:12.989362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:12.999800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0f419a61-c2bb-4e87-9854-70ad0862356c tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1553 microversion: 2.1 time: 0.435280 Oct 12 12:39:13.001234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 85/168] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:12 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1553 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:13.147243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:13.147849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:13.155105 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:13.155595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:13.156023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:13.156718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:13.157165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:13.157586 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:13.326976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:13.330604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:13.335731 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0e479238-32b8-4b39-8ae9-c73d4ef895a6 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.192734 Oct 12 12:39:13.336320 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 84/169] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:13 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:13.945820 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6badf94a-7a18-401e-b206-66515f3231f8", "name": "network-vif-deleted", "tag": "b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:39:13.957037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:13.957511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:13.957948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:13.969430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] Creating event network-vif-deleted:b99d2e17-a5b3-4e5a-91f1-ed54f8f19a0b for instance 6badf94a-7a18-401e-b206-66515f3231f8 on hv-cinder-81268 Oct 12 12:39:13.974701 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-01e53166-812c-4285-b7fd-d1aed3997b04 req-289ebfbe-02f6-430f-8dd1-6af86ba2e603 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032460 Oct 12 12:39:13.975304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 86/170] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:39:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:39:14.029238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:14.030049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:14.039782 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:14.040479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:14.040976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:14.041894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:14.042462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:14.042980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:14.162222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:14.172081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1d24a57a-4530-4b71-a4e3-4378cecdc3e7 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1511 microversion: 2.1 time: 0.146968 Oct 12 12:39:14.172737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 85/171] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:14 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1511 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:14.360856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:14.367969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:14.370641 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:14.371484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:14.372140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:14.373067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:14.373712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:14.374385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:14.554913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:14.562704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4b3c7c20-4f3d-449d-92e7-6d60b106b701 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.207144 Oct 12 12:39:14.563370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 87/172] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:14 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:15.197672 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:15.198399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:15.205530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:15.206637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:15.210449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:15.210449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:15.210449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:15.210449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:15.277711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:15.286059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ff006d13-9498-4b1a-97de-11536e98028b tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1346 microversion: 2.1 time: 0.093460 Oct 12 12:39:15.286637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 86/173] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:15 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1346 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:15.590120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:15.591515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:15.603104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:15.603957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:15.604551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:15.605447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:15.606129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:15.606567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:15.768376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:15.775992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-73ee6b1d-76d8-4a24-8973-dada862214b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.193429 Oct 12 12:39:15.776565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 88/174] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:15 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:16.309209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:16.309824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:16.316729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:16.320661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:16.320661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:16.320661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:16.320661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:16.321136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:16.353036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:16.353513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:16.353948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:16.354412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lazy-loading 'fault' on Instance uuid 6badf94a-7a18-401e-b206-66515f3231f8 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:39:16.401481 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df838ad816744832baa283dabe540394', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '677a44a0d7bb436f83c23a8e74cffa60', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:16.414457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d927f8fa-8d83-4104-8557-f9611cbe64d1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 200 len: 1351 microversion: 2.1 time: 0.108984 Oct 12 12:39:16.415357 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 87/175] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:16 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 1351 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:16.799290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:16.799927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:16.807177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:16.809706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:16.809706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:16.809706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:16.809706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:16.810221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:16.947713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:16.955933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-75439c67-164f-489f-b15f-1a4e81b26212 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.160382 Oct 12 12:39:16.956534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 89/176] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:16 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:17.444116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:17.445693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:17.452000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.452583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.453084 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:17.453861 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.454403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.454897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:17.469470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] HTTP exception thrown: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Request method failure captured: Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 HTTP/1.1 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUzQYo7ul3lk4QIfIHIbXtOsgWfK3_aKlEgwz1IJLaXizB8zgCyJ4cwl_2DcfZj91w0s1-BPNkS_gUUckUzYz2qjc0dwWmxTy4w5M1zmfiUK0e9CFjOrNlUpEWBXAH4Lw5odtG9fBKhv-gUclEfmGkLZIsL_csTZYe9v1B9ZwXmBbc Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:39:17.474772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_677a44a0d7bb436f83c23a8e74cffa60", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: df838ad816744832baa283dabe540394 Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.476208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '6badf94a-7a18-401e-b206-66515f3231f8'} Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:39:17.476887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.478438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.480734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Returning 404 to user: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:39:17.480734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0b719a5e-12d4-4af9-858f-dca2e5e87d36 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 404 len: 111 microversion: 2.1 time: 0.036404 Oct 12 12:39:17.480734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 88/177] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:17 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:39:17.605182 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:17.608587 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:17.615944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.616686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.617920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:17.618718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.619107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.619519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:17.636991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] HTTP exception thrown: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Request method failure captured: Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8/os-volume_attachments HTTP/1.1 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzQYo7ul3lk4QIfIHIbXtOsgWfK3_aKlEgwz1IJLaXizB8zgCyJ4cwl_2DcfZj91w0s1-BPNkS_gUUckUzYz2qjc0dwWmxTy4w5M1zmfiUK0e9CFjOrNlUpEWBXAH4Lw5odtG9fBKhv-gUclEfmGkLZIsL_csTZYe9v1B9ZwXmBbc Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:39:17.642245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_677a44a0d7bb436f83c23a8e74cffa60", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df838ad816744832baa283dabe540394 Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.655531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'server_id': '6badf94a-7a18-401e-b206-66515f3231f8'} Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:39:17.656214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:17.657244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:17.658416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Returning 404 to user: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:39:17.658416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e279f000-cc8d-4653-b19a-1982f857d89e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.043425 Oct 12 12:39:17.658416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 90/178] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:39:17 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:39:17.979403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:17.980028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:17.985901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.986419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.986884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:17.987570 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:17.988024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:17.988460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:18.121017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:18.129355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-dc16e496-3241-4da9-be51-6fbfc889e824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.153882 Oct 12 12:39:18.129917 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 89/179] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:17 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:19.004458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:19.004964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:19.012258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.012734 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.013156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.013837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.014307 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.014723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.027976 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] HTTP exception thrown: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Request method failure captured: Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 HTTP/1.1 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzQYo7ul3lk4QIfIHIbXtOsgWfK3_aKlEgwz1IJLaXizB8zgCyJ4cwl_2DcfZj91w0s1-BPNkS_gUUckUzYz2qjc0dwWmxTy4w5M1zmfiUK0e9CFjOrNlUpEWBXAH4Lw5odtG9fBKhv-gUclEfmGkLZIsL_csTZYe9v1B9ZwXmBbc Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:39:19.030270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_677a44a0d7bb436f83c23a8e74cffa60", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df838ad816744832baa283dabe540394 Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.033758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '6badf94a-7a18-401e-b206-66515f3231f8'} Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:39:19.035086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.036302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.037365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Returning 404 to user: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:39:19.037365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-85d7da55-1bfa-410b-ad72-ee89259f602e tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 404 len: 111 microversion: 2.1 time: 0.031189 Oct 12 12:39:19.037365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 91/180] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:39:18 2022] DELETE /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:39:19.041374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:19.042042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] [instance: 6badf94a-7a18-401e-b206-66515f3231f8] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:19.048441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.049033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.049469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.050342 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.050862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.051396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.065335 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] HTTP exception thrown: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Request method failure captured: Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 HTTP/1.1 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUzQYo7ul3lk4QIfIHIbXtOsgWfK3_aKlEgwz1IJLaXizB8zgCyJ4cwl_2DcfZj91w0s1-BPNkS_gUUckUzYz2qjc0dwWmxTy4w5M1zmfiUK0e9CFjOrNlUpEWBXAH4Lw5odtG9fBKhv-gUclEfmGkLZIsL_csTZYe9v1B9ZwXmBbc Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:39:19.066909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/677a44a0d7bb436f83c23a8e74cffa60"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_677a44a0d7bb436f83c23a8e74cffa60", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 677a44a0d7bb436f83c23a8e74cffa60 Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-DeleteServersTestJSON-1059326301 Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: df838ad816744832baa283dabe540394 Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-DeleteServersTestJSON-1059326301-project Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.068430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '6badf94a-7a18-401e-b206-66515f3231f8'} Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:39:19.069682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. Oct 12 12:39:19.071332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:19.073049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] Returning 404 to user: Instance 6badf94a-7a18-401e-b206-66515f3231f8 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:39:19.073049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d2e391ab-9f44-4a7c-9d8f-c3ae6fa065c1 tempest-DeleteServersTestJSON-1059326301 tempest-DeleteServersTestJSON-1059326301-project] 10.222.0.44 "GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8" status: 404 len: 111 microversion: 2.1 time: 0.031037 Oct 12 12:39:19.073049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 90/181] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:19 2022] GET /compute/v2.1/servers/6badf94a-7a18-401e-b206-66515f3231f8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:39:19.152944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:19.153705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:19.160424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.160978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.161494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.162323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:19.162909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:19.163360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:19.299438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:19.307726 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dd5842ae-4231-4765-995b-031946d0b855 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.159356 Oct 12 12:39:19.308304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 92/182] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:19 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:20.333597 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:20.334595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:20.340865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:20.341284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:20.341715 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:20.342420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:20.342879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:20.343302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:20.603301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:20.612055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9fe56b44-6396-4aeb-9bd1-604e59daa0a5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.283052 Oct 12 12:39:20.613031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 91/183] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:20 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:21.644159 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:21.644893 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:21.653291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:21.654010 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:21.654580 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:21.655383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:21.663762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:21.664451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:21.941438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:21.949809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5b36de4e-6538-49ab-a123-a003092fddce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.313147 Oct 12 12:39:21.950515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 93/184] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:21 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:22.977262 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:22.978122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:22.984902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:22.985524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:22.986103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:22.986949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:22.987505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:22.988584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:23.218634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:23.229751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a956848b-5c36-4a2d-a1f3-c2b3093136d8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.257089 Oct 12 12:39:23.242193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 92/185] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:22 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:24.256373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:24.257089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:24.264468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:24.264970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:24.265461 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:24.266196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:24.266684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:24.267291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:24.429488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:24.438667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4479b2b4-2ce2-4774-a0fd-c3011ff7819f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.187026 Oct 12 12:39:24.439377 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 94/186] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:24 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:25.465894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:25.466600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:25.472906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:25.473395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:25.473823 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:25.474533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:25.478248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:25.478248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:25.615321 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:25.623227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-83fea513-ee2a-4581-a100-87c95ed2f944 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.162701 Oct 12 12:39:25.624111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 93/187] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:25 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:25.949206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5cc77207-db92-49c9-900d-8234f673deee tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Action: 'create', calling method: .version_select at 0x7f9805561550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1395846039", "metadata": {"Type": "work"}}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:39:26.647927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:26.649161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:26.655324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:26.655879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:26.656374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:26.657133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:26.657647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:26.658102 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:26.681262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5cc77207-db92-49c9-900d-8234f673deee tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.859619 Oct 12 12:39:26.682038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 95/188] 10.222.0.44 () {60 vars in 1156 bytes} [Wed Oct 12 12:39:25 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 861 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Oct 12 12:39:26.695641 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f4df0761-a8a1-4645-b3c8-54d666b6aac5 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805534550>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:26.805003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f4df0761-a8a1-4645-b3c8-54d666b6aac5 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 200 len: 353 microversion: 2.1 time: 0.113345 Oct 12 12:39:26.810791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 96/189] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:39:26 2022] GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:39:26.963087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:26.971000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ad9c1fc1-b2b7-449b-98f3-60711fe9f7af tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.327758 Oct 12 12:39:26.971563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 94/190] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:26 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:27.825438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-af32ea6e-a5cc-4a36-9aa3-863213eb086c tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805533310>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:27.874063 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-af32ea6e-a5cc-4a36-9aa3-863213eb086c tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 200 len: 354 microversion: 2.1 time: 0.054565 Oct 12 12:39:27.874632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 97/191] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:39:27 2022] GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 354 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:39:27.890892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-065b98ec-bf5f-47d3-9d2e-5d3997e28e87 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805499f70>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:27.947182 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-065b98ec-bf5f-47d3-9d2e-5d3997e28e87 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 200 len: 354 microversion: 2.1 time: 0.059939 Oct 12 12:39:27.948766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 95/192] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:39:27 2022] GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:39:27.966561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-af7d208b-b247-4bda-89f9-dde53c621b2b tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805534c10>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:27.995383 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:27.996165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:28.002956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:28.004693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:28.005594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:28.006559 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:28.007389 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:28.009453 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:28.162934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:28.171628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ed955c03-cd64-4389-a628-736a9d8b44d1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.181342 Oct 12 12:39:28.172269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 96/193] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:27 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:28.208540 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-af7d208b-b247-4bda-89f9-dde53c621b2b tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 202 len: 0 microversion: 2.1 time: 0.245859 Oct 12 12:39:28.209373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 98/194] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:39:27 2022] DELETE /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 0 bytes in 247 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:39:28.219028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0c085ea0-8c7e-44bd-a44f-a20e4164bf50 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805499040>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:28.269900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0c085ea0-8c7e-44bd-a44f-a20e4164bf50 tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 200 len: 353 microversion: 2.1 time: 0.055463 Oct 12 12:39:28.270595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 97/195] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:39:28 2022] GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:39:29.197355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:29.197987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:29.204158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:29.204635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:29.205119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:29.205732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:29.206202 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:29.207196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:29.284815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-113e3396-fd21-4b22-a352-dd54bd4175fd tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Calling method '.version_select at 0x7f9805499b80>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:29.313726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-113e3396-fd21-4b22-a352-dd54bd4175fd tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] HTTP exception thrown: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-113e3396-fd21-4b22-a352-dd54bd4175fd tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Request method failure captured: Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c HTTP/1.1 Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrV9e4kobV4gt-xUU4U48xv-NuG889x52N4Kbg07pPV7TTx_1vVuC_hgDSgX7RfHIpjW3NuNlfHDm5JSAlwd_q3G72MzGs2EhHGiP_ZnwHI0PTM9YKPejh3x13D6gJJ4p2Sv_MUYAP-t08LoCO4LUG5TlUqGS3A6_I4l24QoGTz0BDU Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: f3276356aa124d428c2bf6bbf2fc6dac Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesGetTestJSON-39230323 Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:39:29.316311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f3276356aa124d428c2bf6bbf2fc6dac"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/f3276356aa124d428c2bf6bbf2fc6dac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/f3276356aa124d428c2bf6bbf2fc6dac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_f3276356aa124d428c2bf6bbf2fc6dac", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesGetTestJSON-39230323 Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: f3276356aa124d428c2bf6bbf2fc6dac Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesGetTestJSON-39230323 Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesGetTestJSON-39230323-project Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: f2d21244b4ae49e8a535de8d4312e09d Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesGetTestJSON-39230323-project Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c'} Oct 12 12:39:29.318245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. (HTTP 404) (Request-ID: req-3c88d68a-6886-472c-bdd9-49fe6e091a1f) Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:29.322184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:39:29.323716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 12:39:29.330930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-113e3396-fd21-4b22-a352-dd54bd4175fd tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] Returning 404 to user: Volume 00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-113e3396-fd21-4b22-a352-dd54bd4175fd tempest-VolumesGetTestJSON-39230323 tempest-VolumesGetTestJSON-39230323-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c" status: 404 len: 109 microversion: 2.1 time: 0.037004 Oct 12 12:39:29.333374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 98/196] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:39:29 2022] GET /compute/v2.1/os-volumes/00ddbe2b-9fe3-4fda-ae1a-4b4bf0b4500c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:39:29.345661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:29.355466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ff0e081a-6db1-409c-a90d-e27f4da567ec tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.162862 Oct 12 12:39:29.356499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 99/197] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:29 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:30.381303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:30.381805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:30.387783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:30.388260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:30.388686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:30.389364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:30.389809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:30.390249 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:30.585083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:30.594411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-41a0c46f-b30e-4199-8acd-3148feba32db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.217653 Oct 12 12:39:30.594974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 99/198] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:30 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:31.618862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:31.619467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:31.628943 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:31.629486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:31.629901 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:31.630627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:31.631539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:31.631973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:31.792227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:31.800097 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5cad705c-91e7-4683-95e1-473e5245fc4d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.185465 Oct 12 12:39:31.801264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 100/199] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:31 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:32.832638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:32.834313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:32.841252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:32.841982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:32.844370 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:32.844370 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:32.844370 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:32.844370 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:32.999879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:33.008641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-afd9a7af-8e9b-44b1-9d61-180c2b9f3efc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.187033 Oct 12 12:39:33.009220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 100/200] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:32 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:34.031400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:34.032125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:34.039227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:34.040289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:34.049290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:34.049290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:34.049290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:34.049290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:34.246041 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:34.254307 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1eda6454-cf44-41ce-9683-593c8863e71d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.226957 Oct 12 12:39:34.254870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 101/201] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:34 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:35.278179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:35.278778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:35.288019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:35.288019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:35.288019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:35.288019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:35.288420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:35.288420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:35.490486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:35.500020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3d2fe58e-fd42-4db9-87e5-a74d92a046fc tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.225716 Oct 12 12:39:35.522062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 101/202] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:35 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:36.542862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:36.542862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:36.542862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:36.542862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:36.543732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:36.543903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:36.544540 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:36.544964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:36.549548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:36.779228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:36.793896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2ff7581c-7b09-432c-be8a-8f024355f0b2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.267737 Oct 12 12:39:36.794504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 102/203] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:36 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:37.818404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:37.819047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:37.820977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:37.825669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:37.826176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:37.826604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:37.831222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:37.831222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:37.831222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:37.976242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:37.984217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9f39b8a0-4246-4e6f-92b0-79497acda811 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.170240 Oct 12 12:39:37.985289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 102/204] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:37 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:39.008959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:39.009876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:39.018472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:39.020144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:39.022470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:39.022470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:39.022470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:39.022470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:39.203762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:39.216027 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d61cd9e9-c11a-469f-9bcd-5694df26bb52 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.210845 Oct 12 12:39:39.216776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 103/205] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:39 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:40.240275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:40.241045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:40.248103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:40.248587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:40.249024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:40.249719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:40.250196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:40.251048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:40.391478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:40.399651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7bbea007-0d34-460a-85d9-bb7126e1f43b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.163294 Oct 12 12:39:40.400243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 103/206] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:40 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:41.428789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:41.429409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:41.431752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=38 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:41.436634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:41.437317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:41.442248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:41.442248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:41.442248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:41.442248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:41.570358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:41.578123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b510708f-e590-4205-8fdd-ab65d99a113a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1522 microversion: 2.1 time: 0.157329 Oct 12 12:39:41.578688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 104/207] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:41 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:42.601362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:42.602033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:42.607961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:42.608453 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:42.609067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:42.609927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:42.610404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:42.610828 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:42.751266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:42.760527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5b5db52f-6741-43eb-bb10-21b30b250531 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1502 microversion: 2.1 time: 0.163908 Oct 12 12:39:42.761254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 104/208] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:42 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:42.783616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:42.784316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:42.792417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:42.792655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:42.793283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:42.794192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:42.794783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:42.795364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:42.942071 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:42.960637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bf067020-f829-4e87-a0d1-aa76ad20c33e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1516 microversion: 2.1 time: 0.182088 Oct 12 12:39:42.961234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 105/209] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:42 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:45.039574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:39:45.041908 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:45.052009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:45.052009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:45.052009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:45.052009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:45.052319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:45.052319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:45.078188 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:39:45.083088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'flavor' on Instance uuid 9a56b7b4-f127-4adf-bf73-a699108a7a11 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:39:45.449145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e5bc7099-edff-42ca-b96d-ab839b8a3f30 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/action" status: 200 len: 32 microversion: 2.1 time: 0.414091 Oct 12 12:39:45.449789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 105/210] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:39:45 2022] POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/action => generated 32 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:39:45.459712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:45.460315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:45.466690 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:45.467179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:45.467616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:45.468316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:45.468770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:45.469191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:45.613783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:45.622410 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-47b7f9fc-5a13-46c1-a85f-0e6431ab36a9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.166890 Oct 12 12:39:45.623184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 106/211] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:45 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:46.651282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:46.652013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:46.658331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:46.658824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:46.659260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:46.659952 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:46.660406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:46.660909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:46.793217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:46.802166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3adb7079-39b1-4fe5-9034-0d1cdfb93be8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.155039 Oct 12 12:39:46.803367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 106/212] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:46 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:47.835391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:47.835997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:47.842376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:47.842852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:47.843277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:47.844139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:47.844839 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:47.845259 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:47.972765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:47.981285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6bbf6caf-67b9-45a2-bd8a-ba79a655b9eb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.150022 Oct 12 12:39:47.981851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 107/213] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:47 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:49.004495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:49.005194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:49.011591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:49.012074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:49.012508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:49.013223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:49.013676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:49.014137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:49.217006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:49.225155 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-553213a3-74eb-4cce-a226-4c1b5d767859 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.224859 Oct 12 12:39:49.225787 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 107/214] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:48 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:50.248877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:50.249486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:50.256370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:50.256846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:50.257276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:50.257978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:50.258446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:50.258845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:50.440788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:50.450116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3942fc12-32ca-48a4-bbfc-b1d85518a7db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.205192 Oct 12 12:39:50.450722 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 108/215] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:50 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:51.139288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:51.139804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:51.146369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:51.146860 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:51.147294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:51.148194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:51.148421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:51.149005 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:51.173636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-af7bcb5e-0773-46ab-9772-4cd760ff32eb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/ips" status: 200 len: 149 microversion: 2.1 time: 0.038287 Oct 12 12:39:51.176704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 108/216] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:39:51 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:39:51.483459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:51.484144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:51.491098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:51.491711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:51.492468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:51.493291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:51.493831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:51.494468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:51.851515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:51.865409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-30829374-190c-4ae7-9ceb-47c71169c230 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.396562 Oct 12 12:39:51.866341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 109/217] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:51 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:52.561719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:52.562853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:52.569687 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:52.570262 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:52.570691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:52.571382 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:52.571857 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:52.575023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:52.596639 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-53eb39a8-39e2-4c68-9ac7-de3b192845f3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/ips" status: 200 len: 152 microversion: 2.20 time: 0.038734 Oct 12 12:39:52.598150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 109/218] 10.222.0.44 () {60 vars in 1289 bytes} [Wed Oct 12 12:39:52 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/ips => generated 152 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:39:52.890892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:52.892046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:52.901227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:52.901878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:52.902426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:52.903347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:52.903561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:52.903974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:53.049136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:53.057919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-64e31ab6-2a43-40dd-b1b0-aceb5a9792aa tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.171289 Oct 12 12:39:53.072925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 110/219] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:52 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:54.069394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d85b3a-9052-4dd5-8a57-1c99664d6957"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:39:54.071623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:54.079261 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:54.079955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:54.083229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:54.083229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:54.083426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:54.083426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:54.083913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:54.084209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:54.090299 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:54.091212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:54.091892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:54.092929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:54.093585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:54.094285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:54.296502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:54.304183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d32220a4-2d11-4040-9bf1-704985921dbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.226521 Oct 12 12:39:54.304748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 111/220] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:54 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:54.961569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-40994fc4-4292-493d-88b8-f23500ff5ed5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.895607 Oct 12 12:39:54.962822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 110/221] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:39:54 2022] POST /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 194 bytes in 899 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:39:54.991436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:39:54.991649 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:55.009904 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.010457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.010948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:55.012094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.012094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.012507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:55.076880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'flavor' on Instance uuid 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:39:55.328904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:55.330339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:55.341000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.341344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.341778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:55.342729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.343452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.344337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:55.683627 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:55.691718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a5af2a50-d5fb-45cb-9d7b-c4b4d75d27fd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.367022 Oct 12 12:39:55.693380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 111/222] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:55 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:39:55.851222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9f4f36f5-c583-421e-a84f-e917eaee28de tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/action" status: 202 len: 0 microversion: 2.20 time: 0.865932 Oct 12 12:39:55.851831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 112/223] 10.222.0.44 () {62 vars in 1319 bytes} [Wed Oct 12 12:39:54 2022] POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/action => generated 0 bytes in 868 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:39:55.861343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:55.862200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:55.869964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.870487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.882874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:55.882874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:55.882874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:55.882874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:56.106337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:56.119909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:56.125508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:56.125508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5ff93a73-79ed-44d9-b5ad-2878a722079b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.266584 Oct 12 12:39:56.125508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 112/224] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:39:55 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:39:56.717701 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:56.718453 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:56.727920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:56.731521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:56.731968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:56.732716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:56.734253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:56.735841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:56.996928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:57.011716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1a4c9fd4-cc75-44dc-a2d9-b8a12e5488e1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.295552 Oct 12 12:39:57.018121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 113/225] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:56 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:57.148913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:57.150127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:57.156973 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:57.157394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:57.157825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:57.158549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:57.159152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:57.159729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:57.381898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:57.390245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:57.391721 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:57.392883 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cba387b9-b904-4e1f-bc4e-3e95f7381417 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.248071 Oct 12 12:39:57.393759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 113/226] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:39:57 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:39:58.052375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:58.053588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:58.064796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:58.065683 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:58.072330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:58.072330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:58.072330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:58.072330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:58.232877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:58.241268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c6dc2f96-7b67-41d5-bf58-5ddc8e162f29 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.194715 Oct 12 12:39:58.242178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 114/227] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:58 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:58.418402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:58.419707 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:58.426582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:58.427072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:58.427698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:58.428711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:58.429640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:58.430372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:58.903343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:58.912505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:58.914090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:58.915495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1f147ff7-4b30-4d4a-91bd-a5dd870d4bc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.501249 Oct 12 12:39:58.916044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 114/228] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:39:58 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:39:59.264840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:59.265456 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:59.273302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:59.274051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:59.274667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:59.275522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:59.276405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:59.277258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:59.451896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:39:59.466761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-376932e0-5d76-4d3d-9672-43fcc8a053ce tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.204201 Oct 12 12:39:59.477695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 115/229] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:39:59 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:39:59.943166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:39:59.945023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:39:59.957251 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:59.958013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:59.958612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:39:59.959480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:39:59.960090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:39:59.960518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:00.239772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:00.250403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:00.252372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:00.253806 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f7ab0108-6468-4646-9c29-8811f788fd09 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.314802 Oct 12 12:40:00.269802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 115/230] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:39:59 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:00.493374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:00.494061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:00.502201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:00.503057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:00.504138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:00.505188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:00.506350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:00.507394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:00.668908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:00.675136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:00.681382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-080b12be-b475-4d54-aa09-f565c6afbd59 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.193785 Oct 12 12:40:00.682412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 116/231] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:00 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:01.284732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:01.286144 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:01.300199 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:01.300849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:01.301485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:01.302368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:01.302969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:01.303542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:01.498715 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:01.507603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:01.509343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:01.534205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d1e608d6-cfd8-48ca-98a5-6ae5651f3ec9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.229994 Oct 12 12:40:01.534943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 116/232] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:01 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:01.712703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:01.713363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:01.723784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:01.724272 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:01.724698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:01.725396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:01.725842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:01.726285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:01.904602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:01.916221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c8861dca-dd77-49bb-a985-b2f92c5b4139 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.212217 Oct 12 12:40:01.924321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 117/233] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:01 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:02.553650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:02.554289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:02.562359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:02.562845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:02.567690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:02.569200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:02.570061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:02.570646 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:02.916247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:02.932067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:02.935635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:02.936857 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-76151b22-f49e-4c55-b530-5bf1e822ddc0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.388369 Oct 12 12:40:02.937438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 117/234] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:02 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:02.960941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:02.961673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:02.969030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:02.969688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:02.970190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:02.971284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:02.971755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:02.972182 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:03.361149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:03.376318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b091f487-a6a6-42f9-b415-d1d4fa866d64 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.419495 Oct 12 12:40:03.380860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 118/235] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:02 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:03.964553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:03.965253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:03.978186 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:03.980941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:03.981396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:03.982223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:03.982693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:03.983137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:04.374789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:04.394417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:04.400840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:04.404004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8c1fa880-4b26-4b9f-8f26-13897feba4b3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.444236 Oct 12 12:40:04.413899 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 118/236] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:03 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:04.416969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:04.419474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:04.437359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:04.440532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:04.441562 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:04.443547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:04.445194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:04.446546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:04.808877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c3941b4b-a002-442c-a728-b912674b7b9b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: .version_select at 0x7f9805542310>, body: {"keypair": {"name": "tempest-keypair-2081483436", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCgHZeiKJ4sdXHuIgFLf/suRZvwGnvHNPmyTQKDJHQz93Fbgzr6DVTLZsScWBKZ/2OP9BVypgMHnLJ7FRN0LvgaLbE+U5yZ8i98ejurhlJF77zh2Ad9yPqLODj2JgMTCgA=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:04.854790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-c3941b4b-a002-442c-a728-b912674b7b9b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:04.866983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-c3941b4b-a002-442c-a728-b912674b7b9b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:04.873876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:04.888061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-82217f8b-01d9-4acd-b80b-962fe9dea714 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.487767 Oct 12 12:40:04.915015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 119/237] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:04 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:05.028733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c3941b4b-a002-442c-a728-b912674b7b9b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.226223 Oct 12 12:40:05.031345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 119/238] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:40:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:40:05.435223 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:05.435889 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:05.443118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:05.443609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:05.444129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:05.445004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:05.445607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:05.446208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:05.674173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:05.686637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:05.690283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:05.692391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1bec4e98-a42d-4f15-9108-85a638e58553 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.261416 Oct 12 12:40:05.694234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 120/239] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:05 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:05.924934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:05.925568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:05.936014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:05.936525 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.058625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.058625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.058625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.058625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.061046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:06.550519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:06.561547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1ca16f07-27dc-428d-b822-b4a248ddc3e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1502 microversion: 2.1 time: 0.640665 Oct 12 12:40:06.562389 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 120/240] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:05 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1502 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:06.590082 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "782b8d8d-ecc0-40d6-9d5b-043fe0cb234c"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:06.601747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:06.601747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.601747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.601747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.602578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.602578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.602578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.627308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] HTTP exception thrown: Cannot 'attach_volume' instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 while it is in vm_state rescued Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Request method failure captured: Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/os-volume_attachments HTTP/1.1 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 74 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrU1VxMPMBEYG6xK_zUp8DE1DjUPcBFE3OVhqKM2683QHF89iGkf8UjWvsnL3mjJzwaoSeXII1nOJ7zmeSEN5FXHuSO0_2YLMuhub4pGMpS3om3FZx39RYQuEsjDTIvOuEkwjYXmEvYOzsDX9qaZ1QF_uijpp2iGTmCm1s7kbI47Shc Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:40:06.628983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d62398af777d4d269977b1a5f1f37080", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 19d863a45ac14c50b940fbc217b70929 Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {"volumeAttachment": {"volumeId": "782b8d8d-ecc0-40d6-9d5b-043fe0cb234c"}} Oct 12 12:40:06.632373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Cannot 'attach_volume' instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 while it is in vm_state rescued Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'server_id': '9a56b7b4-f127-4adf-bf73-a699108a7a11', 'body': {'volumeAttachment': {'volumeId': '782b8d8d-ecc0-40d6-9d5b-043fe0cb234c'}}} Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 in vm_state rescued. Cannot attach_volume while the instance is in this state. Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:40:06.633267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 while it is in vm_state rescued Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:40:06.634603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 while it is in vm_state rescued Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Returning 409 to user: Cannot 'attach_volume' instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 while it is in vm_state rescued {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d41cb4f5-f7c9-496c-8e87-afe039a6a50b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044423 Oct 12 12:40:06.635684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 121/241] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:40:06 2022] POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 12:40:06.639583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:06.640120 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:06.646129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.646623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.647059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.647754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.648365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.648795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.722475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:06.722475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:06.727924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.728593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.729082 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.729849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:06.730387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:06.730892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:06.943599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:06.961685 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:06.963615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:06.965461 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8a45074a-23a5-4cc0-8b95-c55f70e64183 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.250713 Oct 12 12:40:06.966757 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 122/242] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:06 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:06.983228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-03500cee-9118-4e07-8f62-012f9f830cbb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/action" status: 202 len: 0 microversion: 2.1 time: 0.347222 Oct 12 12:40:06.986057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 121/243] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:40:06 2022] POST /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:40:06.995644 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:06.996260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:07.002757 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:07.003456 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:07.003843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:07.004564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:07.005019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:07.005442 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:07.538089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:07.550931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ac535cd0-c537-44ab-bb05-b0d49b484161 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1510 microversion: 2.1 time: 0.557512 Oct 12 12:40:07.565988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 123/244] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:06 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1510 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:07.997118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:07.997960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:08.010280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:08.017530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:08.017530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:08.017530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:08.017530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:08.017897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:08.285001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:08.301474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:08.302993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:08.305219 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c46ec511-7603-493b-bc84-5c7fd28a690c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.314514 Oct 12 12:40:08.307137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 122/245] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:07 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:08.580810 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:08.583871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:08.601401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:08.602386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:08.605059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:08.607277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:08.609220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:08.609898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:08.924941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:08.935860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c68645b5-3725-466e-94c5-86aef701266d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1510 microversion: 2.1 time: 0.360766 Oct 12 12:40:08.937495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 124/246] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:08 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1510 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:09.335827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:09.336710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:09.344117 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:09.344739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:09.345177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:09.346100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:09.346708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:09.347145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:09.527998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-884588562", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f74858ca-46a0-493d-924e-694edecfac99"}], "security_groups": [{"name": "tempest-securitygroup--781459277"}], "key_name": "tempest-keypair-2081483436", "user_data": "}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:09.708632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] validate_networks() for [('f74858ca-46a0-493d-924e-694edecfac99', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:40:09.745154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:09.784603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:09.793374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:09.803270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1065dafa-11b0-40e9-b143-c1daf45527a8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.470909 Oct 12 12:40:09.806499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 123/247] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:09 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:09.964822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:09.966006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:09.977826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:09.982812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:09.982812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:09.982812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:09.982812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:09.983306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:10.299532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:10.311257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-bda28ec9-5832-4e2c-a778-82f3fb94db8e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1510 microversion: 2.1 time: 0.350389 Oct 12 12:40:10.314865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 124/248] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:09 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1510 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:10.424631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:40:10.425055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:40:10.425836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:40:10.426897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:40:10.427828 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:40:10.447566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:10.447566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:10.447566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:10.447566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:10.448008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:10.448008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:10.475302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:10.484631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:10.503035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:40:10.511050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:40:10.677480 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-19cbffea-b18d-40f7-8860-ddf2ebd59a53 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.154026 Oct 12 12:40:10.678153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 125/249] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:40:09 2022] POST /compute/v2.1/servers => generated 401 bytes in 1155 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:40:10.697125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-89d10c03-c389-4cfd-a614-3f560dc74f6b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:10.697911 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-89d10c03-c389-4cfd-a614-3f560dc74f6b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:10.778260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-89d10c03-c389-4cfd-a614-3f560dc74f6b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:10.785965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-89d10c03-c389-4cfd-a614-3f560dc74f6b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1241 microversion: 2.1 time: 0.100346 Oct 12 12:40:10.806203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 126/250] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:10 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1241 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:10.833047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:10.833658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:10.846014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-38bbb81c-5bc8-4c98-9e1a-6466fc79577b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Action: 'create', calling method: .version_select at 0x7f9805478670>, body: {"keypair": {"name": "tempest-TestShelveInstance-1512064642", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJdcJHmCTupVcKmHCSXJ8zHixANKMVbJ/7zgCHY8KkIovPdtbSXWsKS8MOxn44+KkGT5+An+kBFi94w4e9zkFVzciCQF4R0axNQiC/qJvcEQaCesgBDXokDNxxXX0wMPjA=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:10.855195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:10.857105 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:10.860536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:10.861241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:10.862232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:10.862940 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:10.863581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:10.874637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-38bbb81c-5bc8-4c98-9e1a-6466fc79577b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Getting quotas for project b15d78e196664c1aa41be6c5afe4238b. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:10.887174 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-38bbb81c-5bc8-4c98-9e1a-6466fc79577b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Getting quotas for user b0a7f349d8ba4bea9a609e7cf881b1b9 and project b15d78e196664c1aa41be6c5afe4238b. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:11.002771 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-38bbb81c-5bc8-4c98-9e1a-6466fc79577b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.420567 Oct 12 12:40:11.003588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 125/251] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:40:10 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:40:11.102579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:11.112950 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:11.115363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:11.116225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b8616e48-6d3a-4305-add6-58f791a1018c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.287612 Oct 12 12:40:11.117265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 127/252] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:10 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:11.119048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-976886631", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "networks": [{"uuid": "28a68333-5806-4ed4-b231-101d2ee13320"}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:11.187778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] validate_networks() for [('28a68333-5806-4ed4-b231-101d2ee13320', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:40:11.340344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:11.341153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:11.367150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:11.368605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:11.369054 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:11.369780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:11.372002 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:11.372443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:11.564708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:11.583522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a360f5c8-9de7-4c91-b673-288597693be4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1516 microversion: 2.1 time: 0.242330 Oct 12 12:40:11.590135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 128/253] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:11 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1516 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:11.755892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:40:11.756318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:40:11.756793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:40:11.757230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:40:11.757795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:40:11.766888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:11.767369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:11.767804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:11.768532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:11.768987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:11.769411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:11.789851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Getting quotas for project 0c9f0d8dfa9544a9a9fec1c5dad43d74. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:11.793886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Getting quotas for user 07dec04c01264b90aa962053c6d1304a and project 0c9f0d8dfa9544a9a9fec1c5dad43d74. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:11.805509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:40:11.807875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:40:11.820519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8ce4e305-9212-488c-907f-4b74b169cbef tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:11.821134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8ce4e305-9212-488c-907f-4b74b169cbef tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:11.874219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8ce4e305-9212-488c-907f-4b74b169cbef tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:11.881681 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8ce4e305-9212-488c-907f-4b74b169cbef tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1241 microversion: 2.1 time: 0.065894 Oct 12 12:40:11.882346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 129/254] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:11 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:11.968045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-11c20625-66e9-4aae-b4fc-69df7746fea6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.853976 Oct 12 12:40:11.975679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 126/255] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:40:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 862 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:40:11.987357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-97d798c3-d65c-4aa5-844b-f564d647e8a4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:11.987943 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-97d798c3-d65c-4aa5-844b-f564d647e8a4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:12.052575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-97d798c3-d65c-4aa5-844b-f564d647e8a4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:12.059812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-97d798c3-d65c-4aa5-844b-f564d647e8a4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1218 microversion: 2.1 time: 0.076566 Oct 12 12:40:12.060416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 130/256] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:11 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:12.142347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:12.142951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:12.150630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:12.156699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:12.156699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:12.156699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:12.156699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:12.157048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:12.352692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:12.377363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:12.379030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:12.381512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f903dd72-8017-45d0-8978-5876da72dae2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.242201 Oct 12 12:40:12.382499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 127/257] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:12 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:12.908362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:12.909876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:12.915761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:12.931887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:12.931887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:12.931887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:12.931887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:12.932226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:12.932226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:13.012932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:13.024036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ee890a99-8301-40e6-9cc7-db5296935aae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1245 microversion: 2.1 time: 0.122633 Oct 12 12:40:13.024969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 131/258] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:12 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1245 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:13.087788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-be47937d-9b0c-49d5-a148-46806ad02293 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:13.088488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-be47937d-9b0c-49d5-a148-46806ad02293 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:13.143607 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-be47937d-9b0c-49d5-a148-46806ad02293 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:13.151423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-be47937d-9b0c-49d5-a148-46806ad02293 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1218 microversion: 2.1 time: 0.067725 Oct 12 12:40:13.154635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 128/259] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:13 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:13.431861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:13.432464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:13.439062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:13.439536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:13.439964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:13.440702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:13.441149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:13.441570 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:13.670693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:13.679658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:13.681443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:13.682882 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-501171a6-ea36-4b0b-b592-4c946aca5f47 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.254882 Oct 12 12:40:13.683856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 132/260] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:13 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:14.051102 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:14.052694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:14.062600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.063530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.065437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.065437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.066008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.066937 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.150273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:14.163185 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4b5d5d33-aecb-4c68-90c9-47604ae6edc5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1237 microversion: 2.1 time: 0.116285 Oct 12 12:40:14.164212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 129/261] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:14 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1237 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:14.187213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:14.189201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:14.197477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.198207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.198799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.199668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.200278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.202436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.287303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:14.295665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cc627af6-dcb2-417b-80a6-b7391ff65d8b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1270 microversion: 2.1 time: 0.119441 Oct 12 12:40:14.296155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 133/262] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:14 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1270 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:14.653281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9d075da7-53a4-4fdf-94dd-f937838abb2f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: .version_select at 0x7f9805765ee0>, body: {"keypair": {"name": "tempest-keypair-1744795171", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBABNN7a48DZaJUpAvYrJxo74QlZpSeQRrxu9PO746y3L9JFCgyBl5bhqJgNTrQi5NEVCw7Wy8WM5PkaKGPTE0PusTRxBwLGrQ4//Jgj0x00EsZE0fA1n4g7cN0eXEfoWZg=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:14.686622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-9d075da7-53a4-4fdf-94dd-f937838abb2f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for project d62398af777d4d269977b1a5f1f37080. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:14.694497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-9d075da7-53a4-4fdf-94dd-f937838abb2f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for user 19d863a45ac14c50b940fbc217b70929 and project d62398af777d4d269977b1a5f1f37080. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:14.710822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:14.711663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:14.726536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.727244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.731257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.732591 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:14.733242 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:14.733674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:14.832022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9d075da7-53a4-4fdf-94dd-f937838abb2f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.182445 Oct 12 12:40:14.835873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 130/263] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:40:14 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:14.936421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:14.948897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:14.950392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:14.951592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2344f76a-4722-4106-be08-b60a77b0f435 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1744 microversion: 2.20 time: 0.246058 Oct 12 12:40:14.952146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 134/264] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:14 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1744 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:15.193979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:15.193979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:15.198525 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.201815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.201815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:15.201815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.201815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.202579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:15.288075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:15.296331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-467bfe7d-1b35-49ca-9435-f1a8f6f2d143 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1237 microversion: 2.1 time: 0.109554 Oct 12 12:40:15.296909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 131/265] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:15 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1237 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:15.321145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:15.321833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:15.328513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.329317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.330015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:15.330934 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.331588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.332114 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:15.424129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:15.437331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fc6d047c-d98e-4016-a8a6-009f0d3be221 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1278 microversion: 2.1 time: 0.121165 Oct 12 12:40:15.439593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 135/266] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:15 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1278 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:15.984029 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:15.985124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:15.991733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.992416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.993280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:15.994829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:15.995713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:15.996469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:16.179042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:16.190719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:16.193075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:16.194385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5f8a1184-bdaa-4211-b581-253a4a6c509b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1744 microversion: 2.20 time: 0.214580 Oct 12 12:40:16.197076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 132/267] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:15 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1744 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:16.324641 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:16.325254 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:16.333287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:16.333774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:16.334407 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:16.335488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:16.336096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:16.336772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:16.465858 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:16.466795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:16.475833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:16.476248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:16.477562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:16.478308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:16.479802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:16.480236 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:16.484569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:16.493812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ff05085f-874a-4e7f-9d1c-03d1c40006d0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1293 microversion: 2.1 time: 0.173413 Oct 12 12:40:16.500908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 136/268] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:16 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1293 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:16.637651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:16.646400 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-913de263-8d7b-4678-841a-09f6b1af0143 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.184424 Oct 12 12:40:16.647145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 133/269] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:16 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:17.229947 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:17.231850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:17.237552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.238399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.238826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.239723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.240170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.240814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.269060 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:17.524238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:17.528561 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:17.535278 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.535813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.536253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.536961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.537412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.538175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.637420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:17.648547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:17.657927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:17.659585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:17.661663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-689c8c78-b0ab-4666-a95e-a22f635c706e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1744 microversion: 2.20 time: 0.436598 Oct 12 12:40:17.682596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7b1491bb-c8b0-4680-b5c4-2bb41a146da2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1299 microversion: 2.1 time: 0.162066 Oct 12 12:40:17.686630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 134/270] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:17 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1299 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:17.687209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 137/271] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:17 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1744 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:17.692133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "name": "network-vif-plugged", "status": "completed", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:17.702072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.703075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.703660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.704425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:17.705063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:17.716484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.717247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.718330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.719938 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:17.720543 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] Creating event network-vif-plugged:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:40:17.721542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:17.722237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:17.726529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-25bc4fa2-612e-4afd-997a-cc7f485bd269 req-7d02974c-aa8e-4f68-aa5d-8e27a44f1bbe service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038010 Oct 12 12:40:17.728561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 138/272] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:17.906402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:17.919187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ab1d6fdf-6f62-4cfd-be27-a8542dabeda4 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.230331 Oct 12 12:40:17.919953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 135/273] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:17 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:18.696409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:18.697091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:18.710526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:18.711128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:18.716225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.716913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.718007 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.718316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:18.718508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.718950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:18.719510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.719654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.720120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.720354 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.720542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:18.720784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:18.789312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:18.796890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c57447f2-7f60-4084-a808-4f1f44fe262a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1299 microversion: 2.1 time: 0.090716 Oct 12 12:40:18.797458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 136/274] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:18 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:18.948666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:18.949282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:18.960628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.960829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.961296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:18.961926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:18.962419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:18.962892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:19.042161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:19.050571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:19.052658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:19.053969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-df14403c-7602-4f8c-b8ce-45973f40e8a5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.363406 Oct 12 12:40:19.055803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 139/275] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:18 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:19.124913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:19.135358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1966c3ef-836f-4e52-8b64-9d7ea124a4d1 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.191188 Oct 12 12:40:19.148875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 137/276] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:18 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:19.238710 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9785f5a1-07ef-4a37-bc0d-e921e203cc1f", "tag": "f08b5cba-5112-4013-8e2b-0f5f79411723"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:19.251557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:19.252047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:19.252486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:19.265577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] Creating event network-changed:f08b5cba-5112-4013-8e2b-0f5f79411723 for instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f on hv-cinder-81268 Oct 12 12:40:19.271774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-38e0ee3e-5af4-477c-a422-989eb1e65fa2 req-f70bb2ac-9b9d-4841-bd3e-a19abae376b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038534 Oct 12 12:40:19.273516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 140/277] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:19.278974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1627243046", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "1b4ef2f4-49f2-43ce-8f92-68931ce3b901"}], "security_groups": [{"name": "tempest-securitygroup--405582738"}], "key_name": "tempest-keypair-1744795171", "user_data": "}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:19.821005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:19.822552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:19.829605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:19.830127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:19.830618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:19.831314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:19.832075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:19.832308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:20.170825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:20.179119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5f240aef-4687-4f7d-a27e-a4735c928177 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.362405 Oct 12 12:40:20.179685 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 141/278] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:19 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:20.184093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:20.184687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:20.190256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:20.191643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:20.191643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:20.192969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:20.193429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:20.193854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:20.463423 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:20.563620 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:20.573253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:20.574850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:20.576026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a4e3add5-365c-4082-95ea-4bb920534f7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.395426 Oct 12 12:40:20.590848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 142/279] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:20 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:20.600762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:20.601530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:20.607748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:20.608476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:20.608904 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:20.609845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:20.610323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:20.610746 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:20.836363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:20.849118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-36002dfe-3ac2-4813-b771-b8bbff89c37f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.257091 Oct 12 12:40:20.849972 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 143/280] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:20 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:21.203770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:21.204424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:21.211292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.211785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.212221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.212923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.213379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.213801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.352449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:21.364052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4b5eb920-04cb-42e8-92e3-0a7d9e584504 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.164160 Oct 12 12:40:21.367712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 144/281] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:21 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:21.370042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a51ad5-ef04-4f25-961e-6705be7abc42", "tag": "b3a343e1-04ff-45b8-a712-621f39f630db"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:21.379109 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.379577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.379997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.390974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] Creating event network-changed:b3a343e1-04ff-45b8-a712-621f39f630db for instance e3a51ad5-ef04-4f25-961e-6705be7abc42 on hv-cinder-81268 Oct 12 12:40:21.396700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-3de0f0c4-c2c2-427d-b4ee-c13422d74bca req-6ae0750d-50b1-4fde-9292-ae8affe09605 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030828 Oct 12 12:40:21.397538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 145/282] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:21.607674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:21.608244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:21.614583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.615268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.615709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.616405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.616861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.617287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.749850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:21.759923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:21.761420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:21.762717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5adb1a7c-f534-4d6a-b877-a7ac91ca6d15 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.159431 Oct 12 12:40:21.763282 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 146/283] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:21 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:21.779818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:21.873060 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:21.873611 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:21.880057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.880539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.880968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:21.881658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:21.882156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:21.882740 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:22.059047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=12 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:22.117020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:22.129389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9424e550-a7aa-4e53-a1c8-a1d576efe47c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.256239 Oct 12 12:40:22.129389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 147/284] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:21 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:22.388145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:22.388725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:22.395070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:22.395621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:22.396053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:22.396834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:22.397322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:22.397741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:22.655114 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:22.664521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-22420f51-11b4-487f-b5e0-c9cc1aafa438 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.280354 Oct 12 12:40:22.665558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 148/285] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:22 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:22.789902 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:22.790945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:22.799271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:22.799761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:22.800530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:22.801623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:22.802511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:22.803499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:22.939438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:22.947913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:22.949376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:22.950559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-af682faf-8251-448b-8e79-04ec0e45f3a2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.165723 Oct 12 12:40:22.954040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 149/286] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:22 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:23.149253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:23.149964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:23.156648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.157130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.157586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:23.158362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.158817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.159238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:23.318926 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:23.327131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-36fc3362-9dba-4cc4-98bf-3ac0a57c6d6b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.182481 Oct 12 12:40:23.327677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 150/287] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:23 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:23.687635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:23.688240 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:23.694932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.695409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.695835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:23.696515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.696969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.697387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:23.840268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:23.851087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c9e20ee7-d7c0-4401-b0ea-334f4a71751c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.166866 Oct 12 12:40:23.851672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 151/288] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:23 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:23.978101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:23.978771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:23.984902 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.987446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.987446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:23.987446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:23.987446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:23.987767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:24.128798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:24.136914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:24.138378 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:24.139528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b24fb74f-f808-4fa6-8c5d-e93eb2b2ccc7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.166174 Oct 12 12:40:24.140161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 152/289] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:23 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:24.349809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:24.350567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:24.356872 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:24.357466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:24.358022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:24.358846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:24.359315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:24.359744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:24.512196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:24.519833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6afeb539-4476-485a-b92a-f669d8577372 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.173846 Oct 12 12:40:24.520296 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 153/290] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:24 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:24.729565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=20 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:24.876721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:24.877332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:24.886898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:24.887392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:24.887839 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:24.888603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:24.889061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:24.889490 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.243739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:25.251807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-25816ce9-623d-46f7-ba3c-7ddc4efff1af tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.379009 Oct 12 12:40:25.252701 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 154/291] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:24 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:25.257267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:25.257876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:25.263957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:25.264443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:25.264893 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.265748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:25.266287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:25.266709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.448439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:25.458352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:25.459857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:25.461029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8d1f0e0c-3d76-4e4a-92e7-443d4ae239b0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.207400 Oct 12 12:40:25.461583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 155/292] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:25 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:25.543970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:25.544621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:25.551091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:25.555921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:25.555921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.555921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:25.555921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:25.556330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.558531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:25.695390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:25.705059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d039c1a0-ca17-407f-b91c-fe6cf0fc2113 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.165296 Oct 12 12:40:25.706162 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 156/293] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:25 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:25.737752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9785f5a1-07ef-4a37-bc0d-e921e203cc1f", "name": "network-vif-plugged", "status": "completed", "tag": "f08b5cba-5112-4013-8e2b-0f5f79411723"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:25.748363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:25.748836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:25.749263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:25.760072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] Creating event network-vif-plugged:f08b5cba-5112-4013-8e2b-0f5f79411723 for instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f on hv-cinder-81268 Oct 12 12:40:25.765069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-5c979096-54b9-4939-90d6-cc85c32cf0ac req-d152b117-dd57-40af-9a11-96e23f22046c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031578 Oct 12 12:40:25.765759 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 157/294] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:26.276126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:26.276817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:26.282991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.289567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.289567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.289567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.289567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.290138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.435203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:26.443350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3a2d3328-faf6-45d6-a1f3-7a11aefed69c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.171596 Oct 12 12:40:26.443939 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 158/295] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:26 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:26.486869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:26.487509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:26.494279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.494759 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.495190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.496149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.496306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.496725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.623588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:26.631504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:26.632961 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:26.634149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2afba0cb-7660-421c-ad48-92fb913bf9ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.151133 Oct 12 12:40:26.634703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 159/296] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:26 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:26.728537 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:26.729066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:26.734842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.735322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.735751 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.736431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:26.736880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:26.737301 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:26.863723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:26.872541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4a2a26cd-e6f4-4c39-96cb-7eaf74e377be tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1318 microversion: 2.1 time: 0.148337 Oct 12 12:40:26.873111 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 160/297] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:26 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1318 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:27.422043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-757097908", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "networks": [{"uuid": "32bd4761-1cf3-457f-afa4-3d358a5f2bd3"}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:29.134090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:29.290426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=5 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:29.650647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] validate_networks() for [('32bd4761-1cf3-457f-afa4-3d358a5f2bd3', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:40:29.697519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] validate_networks() for [('1b4ef2f4-49f2-43ce-8f92-68931ce3b901', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:40:30.025771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:40:30.026518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:40:30.027098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:40:30.027647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:40:30.028064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:40:30.043129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.043634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.044495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.048465 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.049124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.050070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.069237 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Getting quotas for project 827d3a5990a940049bcb35a219efdef3. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:30.074590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Getting quotas for user c96f2271cf394de1a15fcdfe3d62860a and project 827d3a5990a940049bcb35a219efdef3. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:30.087084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:40:30.089392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:40:30.096008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:40:30.096445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:40:30.096914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:40:30.097314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:40:30.097727 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:40:30.107047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.114196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.114196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.114196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.114196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.114550 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.126291 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:30.130177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Getting quotas for user 19d863a45ac14c50b940fbc217b70929 and project d62398af777d4d269977b1a5f1f37080. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:30.142494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:40:30.144666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:40:30.184478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-effa0704-7d0d-4f55-bf1e-88b4f63d4257 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.766317 Oct 12 12:40:30.185120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 161/298] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:40:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2768 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:40:30.189542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:30.190150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:30.197485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.197905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.198363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.199049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.199501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.199919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.246540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d20b7aff-f765-41a9-8c2c-c1ee783a9b2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 10.973644 Oct 12 12:40:30.255007 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 138/299] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:40:19 2022] POST /compute/v2.1/servers => generated 408 bytes in 10983 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:40:30.261280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:30.263161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:30.280048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.281002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.282371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.290851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.291439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.291951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.344681 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.358110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ce5c9d47-8cef-4424-a0c0-6dc5db74e825 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.171910 Oct 12 12:40:30.358691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 162/300] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:30 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:30.375822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:30.376437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:30.384731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.385229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.385833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.386996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:30.387458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:30.387882 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:30.475126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.483689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.485149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.486354 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-03932758-6214-48f3-89a1-8d462574ca7f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.229438 Oct 12 12:40:30.487033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 139/301] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:30 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:30.511106 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b36bce4f-2f71-4f8c-b9a9-7ebbeaa28b67 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:30.511988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b36bce4f-2f71-4f8c-b9a9-7ebbeaa28b67 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:30.551714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.559466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5c13dd4c-958a-4a38-8c44-d7468779dea7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1507 microversion: 2.1 time: 0.188422 Oct 12 12:40:30.560034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 163/302] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:30 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1507 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:30.564772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-644d519e-3621-4998-8920-f93d324f66ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:30.565371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-644d519e-3621-4998-8920-f93d324f66ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:30.565719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b36bce4f-2f71-4f8c-b9a9-7ebbeaa28b67 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.573544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b36bce4f-2f71-4f8c-b9a9-7ebbeaa28b67 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1213 microversion: 2.1 time: 0.085282 Oct 12 12:40:30.574336 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 140/303] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:30 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:30.645611 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-644d519e-3621-4998-8920-f93d324f66ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:30.657908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-644d519e-3621-4998-8920-f93d324f66ab tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1246 microversion: 2.1 time: 0.096407 Oct 12 12:40:30.659006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 164/304] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:30 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:31.380644 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:31.381795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:31.389401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.389913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.390402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.391098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.391546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.391969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.516808 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:31.517852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:31.533825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:31.541657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.543322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f9020044-a877-4cb4-82d3-29628a9a4e6d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.166863 Oct 12 12:40:31.544094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 141/305] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:31 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:31.556660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.558485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.560472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.562392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.563744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.597111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:31.597745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:31.605094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.610266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.611287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.612253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.615310 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.616554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.786235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:31.803624 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1c1617bc-21b5-4707-988e-926745037643 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1217 microversion: 2.1 time: 0.209285 Oct 12 12:40:31.804249 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 142/306] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:31 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1217 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:31.813180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:31.814248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:31.842330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.842874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.844288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.846519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:31.850509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:31.851064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:31.895744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:31.919830 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:31.924767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:31.927236 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-605155b6-1109-4172-af7b-a28a64c2d980 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.416648 Oct 12 12:40:31.942452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 165/307] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:31 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:31.992679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:32.002035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-95de8d51-27a9-4301-aa5c-0ebaa1615824 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1242 microversion: 2.1 time: 0.196378 Oct 12 12:40:32.020470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 143/308] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:31 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1242 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:32.569693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:32.570357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:32.586366 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.587567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.588215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:32.589131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.589599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.590062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:32.767143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:32.776211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9778c43d-fc78-4704-8afe-95be9359b8ce tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.212511 Oct 12 12:40:32.776871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 166/309] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:32 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:32.844269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:32.845421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:32.858148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.858503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.858933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:32.859637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.860085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.860815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:32.952206 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:32.961416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:32.962146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-667546b8-8f0d-4af4-89e7-a0103b2be7d6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1209 microversion: 2.1 time: 0.121904 Oct 12 12:40:32.966131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 144/310] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:32 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1209 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:32.966648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:32.977895 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.980234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.980671 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:32.981384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:32.981835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:32.982286 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:33.027850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:33.031744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:33.052621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:33.054126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:33.054739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:33.055621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:33.056231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:33.056835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:33.146405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:33.152946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b54f6d76-32d9-49b2-af12-eb176a83ac5d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1298 microversion: 2.1 time: 0.129207 Oct 12 12:40:33.153760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 145/311] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:33 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1298 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:33.180303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:33.199359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:33.200955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:33.202268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d5fc3e64-a545-43fc-a287-135308d1a5c2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.250746 Oct 12 12:40:33.202946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 167/312] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:32 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:33.800078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:33.801320 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:33.814071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:33.815172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:33.817079 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:33.819254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:33.820447 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:33.825728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:33.991954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:33.992568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:34.021837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.022368 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.027951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.028715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.029192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.029623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.251696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.256310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.262155 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6007b068-9c33-403d-bb49-f1bf86686b28 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.465382 Oct 12 12:40:34.278113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e55f6c43-9bf3-43e2-9d4f-ca7515463d76 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1265 microversion: 2.1 time: 0.288857 Oct 12 12:40:34.280572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 168/313] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:33 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1265 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:34.283375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 146/314] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:33 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:34.288505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:34.289309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:34.298536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a51ad5-ef04-4f25-961e-6705be7abc42", "name": "network-vif-plugged", "status": "completed", "tag": "b3a343e1-04ff-45b8-a712-621f39f630db"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:34.304606 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.308150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.308150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.308150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.308150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.308584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.330714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.334001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.334001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.352653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] Creating event network-vif-plugged:b3a343e1-04ff-45b8-a712-621f39f630db for instance e3a51ad5-ef04-4f25-961e-6705be7abc42 on hv-cinder-81268 Oct 12 12:40:34.361678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-bcee5391-c743-4e1a-b27d-fb2be5b15d29 req-cdfe6cab-c5d9-4ab0-afa4-39adb6148a73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078225 Oct 12 12:40:34.366116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 169/315] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:34.372589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:34.373625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:34.383795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.384413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.384955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.385760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:34.386561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:34.390848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:34.404643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.412499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-73114472-d850-49d5-8087-1cc0ad9c26b9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1304 microversion: 2.1 time: 0.127702 Oct 12 12:40:34.413078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 147/316] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:34 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:34.619624 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.649522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.657128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:34.658399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bc4d70b9-31ac-44cd-838b-152218700684 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.293983 Oct 12 12:40:34.678931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 170/317] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:34 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:35.286693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:35.287384 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:35.293927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.294428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.294917 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.298746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.299755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.300339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.309107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:35.310042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:35.319593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.320388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.320878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.321601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.322285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.322707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.452765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.456904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.462324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8361017d-7918-490f-9b4c-af64f4d8f7b6 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1273 microversion: 2.1 time: 0.161434 Oct 12 12:40:35.462898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 171/318] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:35 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1273 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:35.467400 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2f43523f-9579-4bcd-b782-2d90df795954 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.184659 Oct 12 12:40:35.467768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:35.468543 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:35.468700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 148/319] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:35 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:35.488026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.488822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.489248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.490152 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.490632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.491590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.693106 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:35.694993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:35.707381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.709842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.711676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.714032 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:35.714811 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:35.716482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:35.723219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.733441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fcf31331-a097-4cf4-934a-bfd456abcc8f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.269306 Oct 12 12:40:35.738073 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 172/320] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:35 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:35.915326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.924019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.925500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:35.926717 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-efc2a817-bfbd-4241-86a1-50d503817470 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.239220 Oct 12 12:40:35.941975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 149/321] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:35 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:36.487163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:36.487767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:36.490906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:36.494729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:36.494729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:36.499057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.500507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.501332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.502333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.502888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.504033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.505258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.507381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.509459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.510643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.513661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.519390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.670809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:36.679817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9007ed72-7135-46c3-9a7f-d10354b13625 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1366 microversion: 2.1 time: 0.192575 Oct 12 12:40:36.696377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 150/322] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:36 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:36.701603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:36.712737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.713476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.714110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.727079 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] Creating event network-changed:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:40:36.732100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-19750b7c-b7af-46c7-8772-414735f5c4a6 req-1c6a82cd-2388-4034-a61e-d6303f3b5d34 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034208 Oct 12 12:40:36.732713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 151/323] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:36.758191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:36.759138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:36.766462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.767254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.767900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.768847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.769496 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.770178 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.917897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:36.927714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dd765ee3-8138-405e-b24c-fbeb6201ee2d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.444361 Oct 12 12:40:36.930207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 173/324] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:36 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:36.959169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:36.960559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:36.967512 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.968278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.968897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.972235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:36.972820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:36.973283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:36.973903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:36.984537 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-57436963-eea5-4eb0-9c04-63ba9163f17c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.230963 Oct 12 12:40:36.994546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 152/325] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:36 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:37.148943 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:37.158605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:37.160053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:37.161225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e53b8af4-df26-45fa-97ac-35f3fb8a7ba6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.207402 Oct 12 12:40:37.161780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 174/326] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:36 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:37.703068 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:37.706478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:37.712323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.712850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.713391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:37.714175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.714822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.715441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:37.930276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:37.939122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8aa0bc33-e090-4705-bb07-a771c3c18258 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1557 microversion: 2.1 time: 0.240042 Oct 12 12:40:37.949979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 153/327] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:37 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1557 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:37.952983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:37.954220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:37.962316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.963100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.963747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:37.964319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:37.964990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.965153 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:37.965655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.966212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:37.972982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.975688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.976839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:37.977742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:37.978452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:37.979049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:38.079760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c11d8160-527e-40db-9aa8-dcece1ff2736 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.120476 Oct 12 12:40:38.085144 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 154/328] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:40:37 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:38.099169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:38.100015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:38.106903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:38.107628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:38.108239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:38.109195 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:38.109864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:38.110463 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:38.654673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:38.658689 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:38.665448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3acf926b-a8f2-4ebc-90ed-ea74297f6741 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.716402 Oct 12 12:40:38.666567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 175/329] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:37 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:38.671933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:38.672629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:38.681517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:38.683675 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:38.683675 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:38.684417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:38.685149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:38.685779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:38.697699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:38.714090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-41fecfbd-ac37-4fa0-9646-6ba4e8c40442 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.619560 Oct 12 12:40:38.733252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 155/330] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:38 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:39.058777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:39.122289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:39.122289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:39.124590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a3419a77-6c51-4aaf-8530-db35c54d9030 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.454684 Oct 12 12:40:39.125383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 176/331] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:38 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:39.597087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3a51ad5-ef04-4f25-961e-6705be7abc42", "tag": "b3a343e1-04ff-45b8-a712-621f39f630db"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:39.611473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:39.612636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:39.613875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:39.628428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] Creating event network-changed:b3a343e1-04ff-45b8-a712-621f39f630db for instance e3a51ad5-ef04-4f25-961e-6705be7abc42 on hv-cinder-81268 Oct 12 12:40:39.633745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-ae7fe763-e420-42a4-8b18-04f340f5d678 req-bdb06a2d-619a-4c5d-9faa-5a7274769fec service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041234 Oct 12 12:40:39.639170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 156/332] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:39.692478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:39.694489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:39.702450 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:39.711571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:39.711571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:39.711571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:39.711571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:39.712048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:39.743134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:39.746237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:39.753480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:39.753997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:39.754462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:39.755424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:39.755884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:39.756898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:40.010250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:40.014803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:40.022981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b6f63e2e-4bf2-4990-ba9c-e6b7eb24d246 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.284835 Oct 12 12:40:40.024068 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 157/333] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:39 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:40.029403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f706cb9a-b0ad-46bc-94f4-e89e468e4024", "tag": "bb5b2fee-ff37-496e-847f-922d0d418ff8"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:40.057591 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:40.064375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:40.064859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:40.067560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:40.112212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] Creating event network-changed:bb5b2fee-ff37-496e-847f-922d0d418ff8 for instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 on hv-cinder-81268 Oct 12 12:40:40.118691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-c2301efc-5cae-47be-bbd3-3495e6ee004c req-268d1544-b5df-4151-bb09-f377163c8b73 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092782 Oct 12 12:40:40.123558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 158/334] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:40.154714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:40.155485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:40.158621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:40.168078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:40.168358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ef17617e-fb69-4539-9cc7-0e59721b6f42 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.482085 Oct 12 12:40:40.185691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:40.188915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:40.188915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:40.188915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:40.188915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:40.190286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:40.193255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 177/335] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:39 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:40.420859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:40.434588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:40.437905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:40.439879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-98e3344d-c3f5-4cb0-94bc-ba9f0988d179 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.289361 Oct 12 12:40:40.441017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 159/336] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:40 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:40:41.048551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:41.049172 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:41.061145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=8 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:41.077048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.079555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.080805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.081754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.082404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.083015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.202696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:41.205580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:41.214014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=8 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:41.216579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.217645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.218338 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.219620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.220318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.221152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.474013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:41.491300 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8fc89ca7-7570-4c06-9f25-0213c6707d41 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.442409 Oct 12 12:40:41.494078 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 178/337] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:41 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:41.520877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:41.522975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:41.540515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.543447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.546569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.546569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:41.546569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:41.546569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:41.556880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:41.569905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-256f7901-2933-468e-a7fa-4b348d2181df tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.373502 Oct 12 12:40:41.575060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 160/338] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:41 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:41.856161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:41.874479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:41.877807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:41.877807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ec37ca74-629b-408a-9bf7-371fa7630442 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.381922 Oct 12 12:40:41.878290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 179/339] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:41 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:42.528903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:42.530726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:42.537925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.538661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.539267 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:42.540173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.540986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.541568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:42.596493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:42.597080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:42.608868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.609393 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.610255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:42.611049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.615095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.616115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:42.729059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:42.760587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9419577f-0967-4750-89bf-4ac540b69cc5 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.235903 Oct 12 12:40:42.772449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 161/340] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:42 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:42.790324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:42.798173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fd96f52b-3558-4138-8c85-8faa7f1fc783 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.205343 Oct 12 12:40:42.810323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 180/341] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:42 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:42.905809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:42.906433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:42.912387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.914930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.914930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:42.914930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:42.914930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:42.915322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:43.070505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:43.081065 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:43.085431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:43.086851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ef5f9966-4d17-40c2-9aea-c97370122366 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.185980 Oct 12 12:40:43.087521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 162/342] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:42 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:43.795298 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:43.795963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:43.802909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:43.803399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:43.803858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:43.804577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:43.805028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:43.805448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:43.824575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:43.825507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:43.833334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:43.833971 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:43.835293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:43.836089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:43.836647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:43.837200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:43.947120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:43.954790 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-68751941-f265-4d6b-ad17-5017af98960c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.163514 Oct 12 12:40:43.955678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 181/343] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:43 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:43.987517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:43.996847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b7799956-0889-420b-bb28-c1ab30227aab tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.176631 Oct 12 12:40:43.997563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 163/344] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:43 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:44.115140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:44.116538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:44.123422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:44.123992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:44.124424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:44.127732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:44.128291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:44.128743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:44.291586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:44.316183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:44.318240 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:44.319957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ccd92399-f37d-49f4-8d99-880dfb7bb352 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.208700 Oct 12 12:40:44.326195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 182/345] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:44 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:44.979518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:44.980026 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:44.986502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:44.986978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:44.987404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:44.988080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:44.988527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:44.988945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:45.024799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:45.024799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:45.029479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:45.030004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:45.030625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:45.031536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:45.032182 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:45.032611 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:45.120903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:45.130567 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-858b61f9-f40c-4771-b7aa-0562ac8f46b4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.155458 Oct 12 12:40:45.131238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 164/346] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:44 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:45.179098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:45.186652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e3e4e807-d4b4-4e41-8355-863af4c5a03a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.169891 Oct 12 12:40:45.187210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 183/347] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:45 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:45.364694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:45.365428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:45.372028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:45.372628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:45.373132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:45.374035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:45.374480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:45.374909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:45.719338 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:45.727431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:45.728890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:45.730090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b79a9c4f-a317-4f2b-ae5e-5906fe9990fa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.369335 Oct 12 12:40:45.730644 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 165/348] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:45 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:46.154473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:46.155083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:46.161478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.161999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.162440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.163129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.163584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.164009 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.209519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:46.210666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:46.216974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.217459 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.217896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.218610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.219067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.219491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.289873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:46.297663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b49603ce-4fd0-40b6-aafc-95f6854be4fb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.146998 Oct 12 12:40:46.299913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 184/349] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:46 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:46.344409 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:46.352071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f26b9c9f-55f2-41a3-9cbc-eb95116cc37f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.146435 Oct 12 12:40:46.352634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 166/350] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:46 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:46.755731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:46.756369 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:46.762364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.762848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.763281 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.763968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:46.764422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:46.764843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:46.894381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:46.902425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:46.903878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:46.905042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d5d9fc86-0235-4cc6-a908-f68988ad3541 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.153288 Oct 12 12:40:46.905600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 185/351] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:46 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:47.321275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:47.321894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:47.328353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.328836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.329269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:47.329969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.330431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.330871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:47.375141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:47.375909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:47.381958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.383048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.383475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:47.384157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.384601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.385014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:47.463245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:47.471287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4312c2e6-d31f-4110-bf83-9fbd1da0f0e8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.154476 Oct 12 12:40:47.471939 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 167/352] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:47 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:47.516607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:47.524853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1befef6b-9b40-4c11-869b-456eaa1713ca tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.153435 Oct 12 12:40:47.525418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 186/353] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:47 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:47.930918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:47.934478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:47.938031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.938518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.939047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:47.939622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:47.940071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:47.940592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:48.072999 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:48.077446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:48.079806 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:48.081082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6954ceaf-217f-405e-abd0-1e7bfd363531 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.154519 Oct 12 12:40:48.081707 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 168/354] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:48.494372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:48.495086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:48.501374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:48.501860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:48.502337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:48.503030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:48.503482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:48.503904 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:48.547443 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:48.548181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:48.554554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:48.555114 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:48.555606 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:48.556358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:48.556877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:48.557378 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:48.634703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:48.643139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4d5fd8f3-f015-43c0-9089-4e4a9d1792e4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.153008 Oct 12 12:40:48.644676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 187/355] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:48 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:48.695535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:48.703279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-eac60fbc-3096-4061-aad1-2fd83f9c7972 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.159689 Oct 12 12:40:48.703840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 169/356] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:48 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:49.109299 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:49.110017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:49.117091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.117912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.121518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.121518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.121518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.121518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.255300 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:49.263930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:49.265409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:49.266589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d4f84358-1e66-4f53-aabd-863e63bc4dac tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1739 microversion: 2.20 time: 0.161390 Oct 12 12:40:49.267145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 188/357] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:49 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1739 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:49.666548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:49.667169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:49.673480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.673986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.674425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.675119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.675571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.675993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.727344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:49.727946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:49.735752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.736408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.736996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.737869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:49.739045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:49.739698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:49.814319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:49.825306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1077b4f8-2e15-49d6-a2fb-326dfb226ff1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.163046 Oct 12 12:40:49.827993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 170/358] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:49 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:49.885851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:49.893568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b7e50e4a-0428-4e12-b8cc-ea2c5d1db557 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.170806 Oct 12 12:40:49.895113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 189/359] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:49 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:50.292710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:50.293339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:50.299337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.299824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.300257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.300946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.301399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.301821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.430927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:50.437854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:50.439340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:50.440510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-11a3c6d7-42b3-4692-8bc7-b1252b7ef492 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1721 microversion: 2.20 time: 0.152346 Oct 12 12:40:50.441061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 171/360] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:50 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:50.848823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:50.849451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:50.855920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.856401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.856831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.857512 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.857990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.858412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.917051 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:50.917885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:50.924379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.924875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.925304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.926024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:50.926479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:50.926903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:50.991427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:51.000283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e343a8fc-4cf2-4f99-8449-15e40319387f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.155468 Oct 12 12:40:51.000855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 190/361] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:50 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:51.070127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:51.070127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2f67e52e-bd8f-47b4-bc23-be7f44abbba9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.157045 Oct 12 12:40:51.071001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 172/362] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:50 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:51.473031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:51.473702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:51.480481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:51.480965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:51.481426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:51.482139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:51.482593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:51.483014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:51.886091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:51.894651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:51.896127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:51.897270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bd1d2de7-27b5-4585-a98a-8cb3daf9b93c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1721 microversion: 2.20 time: 0.428245 Oct 12 12:40:51.897852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 191/363] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:51 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1721 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:52.020977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "name": "network-vif-plugged", "status": "completed", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:52.027589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:52.028194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:52.034575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.035136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.035560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.038273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.038273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.038273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.040729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.041204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.041630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.052625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] Creating event network-vif-plugged:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:40:52.057294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:52.057682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-1cab9b37-0ac0-4937-a99a-e5541f9fa1c7 req-ff7ec6f3-1eb3-4014-8656-981ff96e0f5b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042648 Oct 12 12:40:52.058312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 173/364] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:40:52.103316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:52.104033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:52.110540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.111032 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.111653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.112682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.113378 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.114036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.185591 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:52.194507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-43c5c64c-dd50-4609-9d7c-ded7baa5d654 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.171521 Oct 12 12:40:52.195089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 192/365] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:52 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:52.261022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:52.269129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0444b6be-a1ae-4cd4-b349-89620c64c4b2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.170050 Oct 12 12:40:52.269733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 174/366] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:52 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:52.923098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:52.923741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:52.930676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.931156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.931583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:52.932264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:52.932711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:52.933131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.064232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:53.072585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:53.074055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:53.075204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a56b5b03-c877-4e19-929d-17469c01fafe tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1721 microversion: 2.20 time: 0.156154 Oct 12 12:40:53.075755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 193/367] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:52 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:53.218109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:53.218715 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:53.225105 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.225582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.226038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.226716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.227163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.227579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.298552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:53.299278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:53.305371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.306188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.306645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.307330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.307782 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.308205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.360959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:53.365158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:53.371047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f3aea0d6-bbf6-4525-95a5-645feb5e25ef tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.156580 Oct 12 12:40:53.371664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 175/368] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:53 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:53.399250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-560748408", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1512064642", "security_groups": [{"name": "tempest-secgroup-smoke-35834723"}], "networks": [{"uuid": "67fe8886-6694-423c-8a16-f3bf148c60e0"}], "block_device_mapping_v2": [{"uuid": "09081afd-3496-4f89-af0e-dd7c7cddd0f4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:53.456942 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:53.466578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-03005d27-29f5-489e-b1e3-982b3f261b08 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.171819 Oct 12 12:40:53.467144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 194/369] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:53 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:53.519363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] validate_networks() for [('67fe8886-6694-423c-8a16-f3bf148c60e0', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:40:53.893603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:40:53.897566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:40:53.898085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:40:53.898495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:40:53.898905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:40:53.909177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.910998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.913591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.913591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:53.913591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:53.913591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:53.924820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:40:53.930886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Getting quotas for project b15d78e196664c1aa41be6c5afe4238b. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:40:53.935944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Getting quotas for user b0a7f349d8ba4bea9a609e7cf881b1b9 and project b15d78e196664c1aa41be6c5afe4238b. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:40:54.000545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:40:54.002728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='09081afd-3496-4f89-af0e-dd7c7cddd0f4',volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:40:54.074752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "name": "network-vif-unplugged", "status": "completed", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:54.083560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.087408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.087408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.100049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] Creating event network-vif-unplugged:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:40:54.105629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-f173fe91-4a6e-44fe-b68e-41100fdfe33c req-e18f5043-51e0-44d2-aaf5-f6e47e16157e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036989 Oct 12 12:40:54.106352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 195/370] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:54.114323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:54.115007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:54.121846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.122356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.122783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.124765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.125226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.125650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.345818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.354873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.356328 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.357499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5a39ad26-b1ca-4cff-9fb5-428770fc8a77 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1721 microversion: 2.20 time: 0.247113 Oct 12 12:40:54.358387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 196/371] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:54 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1721 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:54.395553 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:54.396365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:54.404959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.406461 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.407340 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.408730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.409352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.411452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.432340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f00e2549-ad02-4099-b9b1-4655d7e54fa5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.034718 Oct 12 12:40:54.433035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 176/372] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:40:53 2022] POST /compute/v2.1/servers => generated 404 bytes in 1038 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:40:54.444049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-515fb073-8d72-4ff1-b5fc-c3cc0bd8fbbf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:54.445097 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-515fb073-8d72-4ff1-b5fc-c3cc0bd8fbbf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:54.500128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-515fb073-8d72-4ff1-b5fc-c3cc0bd8fbbf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.506954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-515fb073-8d72-4ff1-b5fc-c3cc0bd8fbbf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1088 microversion: 2.1 time: 0.066853 Oct 12 12:40:54.507515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 177/373] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:54 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1088 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:54.517602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:54.517602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:54.519522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.520526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.521221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.522115 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:54.522708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:54.523273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:54.600640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.613967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4ae249e0-2725-4a45-8337-d3967028df9b tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.222227 Oct 12 12:40:54.614571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 197/374] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:54 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:40:54.781666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:54.789411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c1f1769c-da2d-48fe-b32a-2598951d5eb5 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.280759 Oct 12 12:40:54.795573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 178/375] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:54 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:55.331909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cb3326c0-8f91-4185-9566-566fb051452f", "device": "/dev/sdb"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:55.335138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:55.342279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.342794 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.343230 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.344118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.344765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.345188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.384038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:55.384693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:55.392177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.392976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.393607 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.394501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.395110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.395693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.536864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:55.545795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:55.547359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:55.548715 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f9227bfa-37a7-4ea2-8e5a-24e893d64c70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1724 microversion: 2.20 time: 0.169338 Oct 12 12:40:55.550029 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 179/376] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:55 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:55.554919 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:55.555518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:55.561861 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.562394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.562806 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.563674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.564218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.564637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.627761 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:55.635920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-386966b7-e93c-4626-adea-cb48d55606ea tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1138 microversion: 2.1 time: 0.084917 Oct 12 12:40:55.636485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 180/377] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:55 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:55.641264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f42dc8f1-c111-4692-bfe3-b7eaa1a3b61b"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:55.643717 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:55.649395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.649911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.650350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:55.651036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:55.651494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:55.651918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.168643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-acce85b6-98a1-4545-98f9-70e4f6b41fb6 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "POST /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.840761 Oct 12 12:40:56.174722 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 198/378] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:40:55 2022] POST /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f/os-volume_attachments => generated 194 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:56.175933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:56.183628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:56.183628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.184003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.184556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.185437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.186075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.186525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.350154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:56.357778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f6d60e6b-b9aa-40ad-a454-7d973815bdc8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1371 microversion: 2.1 time: 0.186946 Oct 12 12:40:56.358383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 199/379] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:56 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1371 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:56.362812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:56.363409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:56.369044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.369524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.369993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.370653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.371100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.371521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.499140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:56.506738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-13ab9a2f-b693-41b9-afeb-5421884ba628 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.147367 Oct 12 12:40:56.507459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 200/380] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:56 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:56.512243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f706cb9a-b0ad-46bc-94f4-e89e468e4024", "name": "network-vif-plugged", "status": "completed", "tag": "bb5b2fee-ff37-496e-847f-922d0d418ff8"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:56.521767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.522281 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.522713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.534476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] Creating event network-vif-plugged:bb5b2fee-ff37-496e-847f-922d0d418ff8 for instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 on hv-cinder-81268 Oct 12 12:40:56.539186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-c04b6934-6ad3-4914-a4b8-f4194380acca req-d97869f4-5c06-47e8-945e-e2521538c15a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030788 Oct 12 12:40:56.539759 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 201/381] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:40:56.634071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-46cb5c89-7b99-4f34-98ff-519fa1d6df38 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.996287 Oct 12 12:40:56.634574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 181/382] 10.222.0.44 () {62 vars in 1364 bytes} [Wed Oct 12 12:40:55 2022] POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments => generated 188 bytes in 998 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:40:56.659205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:56.660027 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:56.666107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.666579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.667049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.667729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.668170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.668584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.734441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:56.742357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-52575305-5104-4514-9880-82ccdf65de31 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1130 microversion: 2.1 time: 0.087781 Oct 12 12:40:56.743059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 202/383] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:56 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1130 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:56.761539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:56.762277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:56.768129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.768694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.769123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.769803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:56.770278 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:56.770698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:56.812364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130866) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 12:40:57.163253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d5e1c3a9-0b50-4df3-8a6f-a29c2fc36772 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/action" status: 202 len: 0 microversion: 2.20 time: 0.406047 Oct 12 12:40:57.164472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 182/384] 10.222.0.44 () {62 vars in 1319 bytes} [Wed Oct 12 12:40:56 2022] POST /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:40:57.173654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:57.174107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:57.180401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.181125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.181515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.182294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.182831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.183647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.312946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.324872 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.324872 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.326474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c8577f3f-65af-46eb-bdbc-9aa54b270e02 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1750 microversion: 2.20 time: 0.157702 Oct 12 12:40:57.327023 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 203/385] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:57 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1750 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:57.381560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:57.382530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:57.390439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.393034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.393034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.394135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.394907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.395520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.529718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:57.530932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:57.536734 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.537222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.537832 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.538609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.539071 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.539508 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.552517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.561240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-374c59e0-2d80-4d70-9af4-1fb31e9130e0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1566 microversion: 2.1 time: 0.184439 Oct 12 12:40:57.561980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 183/386] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:57 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1566 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:57.584219 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:57.584719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:57.591003 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.591489 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.591925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.592622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.593074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.593498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.670619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-94a45cf2-b085-4db7-bc40-6f431cc5eb88 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090153 Oct 12 12:40:57.671379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 184/387] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:40:57 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-interface => generated 285 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:40:57.681322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.689712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0026c56e-4101-422a-9bd4-552885c004e3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.163797 Oct 12 12:40:57.690383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 204/388] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:57 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:57.766580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:57.767386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:57.775494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.776008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.777479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.778218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:57.778669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:57.779093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:57.857102 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:57.866051 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a8760323-a7ce-4309-8d59-80b3393625f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1186 microversion: 2.1 time: 0.103387 Oct 12 12:40:57.867549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 185/389] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:57 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1186 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:58.352829 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:58.353725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:58.360419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.361151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.367833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.367833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.367833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.367833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.508041 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:58.525168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:58.526708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:58.528053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-57ac29b6-4269-4af0-b2aa-b43e70f6bccf tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1750 microversion: 2.20 time: 0.179463 Oct 12 12:40:58.528602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 205/390] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:58 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1750 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:58.716793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:58.717318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:58.724487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.724983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.727287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.727287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.727287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.728534 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.765492 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:40:58.775544 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.776024 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.776619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.788343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] Creating event network-changed:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:40:58.794468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-e8647526-c9d8-4b1c-97d9-47c71409f26f req-39aa736b-8286-4369-8d86-03212e3778b3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032508 Oct 12 12:40:58.795096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 206/391] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:40:58.865362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:58.873838 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-971dca47-a2d3-4d79-81ca-80b5e098e27e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1313 microversion: 2.1 time: 0.161062 Oct 12 12:40:58.874502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 186/392] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:58 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:58.893096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:58.893783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:58.899802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.900276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.900705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.901903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:58.902397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:58.902795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:58.964575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:58.973918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6ff4ef9f-2a8d-4f10-963a-6eb92b13d329 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1186 microversion: 2.1 time: 0.083339 Oct 12 12:40:58.973918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 207/393] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:58 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1186 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:40:59.554201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:59.554803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:59.560657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:59.561134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:59.561560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:59.562286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:59.562733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:59.563149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:59.694563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:59.704397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:59.705894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:40:59.707102 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e4899dbf-f679-45da-a636-d4b0980aa34a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1750 microversion: 2.20 time: 0.156835 Oct 12 12:40:59.707662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 187/394] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:40:59 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1750 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:40:59.896394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:59.897141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:40:59.905806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:59.906338 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:59.906793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:59.907489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:40:59.907949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:40:59.908379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:40:59.996365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:40:59.998146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:00.004825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:00.005324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:00.005749 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:00.006504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:00.007124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:00.007542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:00.078372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:00.087184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-74cc6f22-4e0f-4ee3-98ef-695f321c86c0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1194 microversion: 2.1 time: 0.095678 Oct 12 12:41:00.087917 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 188/395] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:59 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1194 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:00.218166 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:00.226377 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1a4f724f-7033-4f37-b6ae-3a44fa7044fa tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1497 microversion: 2.1 time: 0.334079 Oct 12 12:41:00.226936 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 208/396] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:40:59 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1497 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:00.733307 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:00.734419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:00.740979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:00.741533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:00.742082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:00.742851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:00.743599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:00.744402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:00.877635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:00.887179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:00.888702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:00.890067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1350a332-bab3-439e-855f-057e2586c2ea tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.161314 Oct 12 12:41:00.890530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 189/397] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:00 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:01.116505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:01.117122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:01.124619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.125255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.125691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.126629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.127107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.127880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.247967 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:01.248462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:01.255089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.259712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.259712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.259712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.259712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.260054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.284216 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:41:01.287057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:01.304578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:01.311235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:01.316346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-38d721d9-e408-4953-bcf9-cb17f5a000ad tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.204270 Oct 12 12:41:01.331196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 209/398] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:01 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:01.538088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-46594cf0-d40e-404b-9d38-e54a4f92c68f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 204 len: 0 microversion: 2.1 time: 0.294237 Oct 12 12:41:01.541415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 190/399] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:41:01 2022] DELETE /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:41:01.547780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:01.549972 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:01.557153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.557610 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.558658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.559534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.560164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.560586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.711768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:01.719438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1b6143af-1f52-4ee8-b69f-4b8bd5ad4f5d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.175901 Oct 12 12:41:01.720027 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 210/400] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:01 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:01.917974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:01.918665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:01.927792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.927792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.927792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:01.927792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:01.928202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:01.928202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.059257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:02.070225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:02.071776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:02.073207 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c89f182c-43e8-4176-99c4-9be429888db0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.160171 Oct 12 12:41:02.081168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:02.086402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 191/401] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:01 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:02.091838 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:02.092340 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:02.092766 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.103795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] Creating event network-changed:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:41:02.109020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-fa405f1b-bf7e-4104-963e-7ecf0da3b6fa req-6c61e02b-68e6-4293-909b-a6da139f1031 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031777 Oct 12 12:41:02.109605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 211/402] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:02.341196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:02.341737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:02.348082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:02.348549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:02.349003 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.349675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:02.350150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:02.350856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.476241 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:02.483807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-090cc39a-f166-4b2e-94e6-4396f9b731c5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.147194 Oct 12 12:41:02.484363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 192/403] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:02 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:02.744254 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:02.744949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:02.751564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:02.752042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:02.752473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.753159 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:02.753607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:02.754064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:02.878434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:02.886062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3ee0b675-ac44-4ca3-9ad8-9a9b82323b1d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.146692 Oct 12 12:41:02.887171 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 212/404] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:02 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:03.099612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:03.100216 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:03.106972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.107487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.107924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.108622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.109075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.109505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.237245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:03.249130 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:03.250673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:03.251829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2d196f26-bf81-4c35-b492-497847f6e4f7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.156209 Oct 12 12:41:03.252424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 193/405] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:03 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:03.506870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:03.507714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:03.513721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.514235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.514668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.515358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.515809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.516227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.641248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:03.648884 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a223892c-5738-45b3-bc80-49812e12f87a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.146057 Oct 12 12:41:03.649441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 213/406] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:03 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:03.909484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:03.910118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:03.916836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.917309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.917735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.918440 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:03.918890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:03.919309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:03.923570 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:04.045035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:04.052628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4d26ec41-9a18-48bf-990f-22de5155e5ed tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.147009 Oct 12 12:41:04.053190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 194/407] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:03 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:04.276580 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:04.277189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:04.283726 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:04.284214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:04.284643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:04.285328 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:04.285777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:04.286221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:04.412312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:04.420727 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:04.422214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:04.423358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-178782cb-adff-4a38-9fac-5adee47b7d23 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.150692 Oct 12 12:41:04.423908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 214/408] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:04 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:04.671686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:04.672288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:04.674409 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=8 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:04.679033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:04.679521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:04.679951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:04.680629 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:04.681075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:04.681542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:04.808521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:04.816855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-749c1bf2-132b-4e23-9abc-9fa11088c017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.149430 Oct 12 12:41:04.817358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 195/409] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:04 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:05.075561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:05.076169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:05.082318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.082798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.083226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.083909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.084359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.084779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.209606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:05.217796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a6f3538d-ad8b-4cbe-adb3-4a8d1833363d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.146146 Oct 12 12:41:05.218385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 215/410] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:05 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:05.448655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:05.449856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:05.456946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.457428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.457865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.458584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.459066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.459492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.586824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:05.595953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:05.597407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:05.598590 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d5a126f8-f6d2-425b-abd1-8640625ce75f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.153882 Oct 12 12:41:05.599150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 196/411] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:05 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:05.839383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:05.840048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:05.846378 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.846858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.847285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.847971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:05.848421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:05.848838 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:05.977294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:05.985398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-115251c5-99d4-4276-bc63-7edcc771a86f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.149864 Oct 12 12:41:05.985969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 216/412] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:05 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:06.240488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:06.241092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:06.248022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:06.248492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:06.248917 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:06.249592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:06.250072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:06.250493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:06.375592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:06.383276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-adec1521-f905-4497-b0a4-9483f770bd6c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.146671 Oct 12 12:41:06.383848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 197/413] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:06 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:06.623314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:06.623849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:06.629837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:06.630349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:06.630782 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:06.631467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:06.631918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:06.632347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:06.758036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:06.767003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:06.768483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:06.769638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-12a2b2ef-7462-4869-abfa-1cf30d590fbd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.150709 Oct 12 12:41:06.770224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 217/414] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:06 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:07.008552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:07.009225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:07.016178 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.016658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.017094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.017785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.018305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.018732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.150428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:07.158083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8ccdff74-6d0e-43c2-933f-0a0030a5e820 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.153338 Oct 12 12:41:07.158645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 198/415] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:07 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:07.406154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:07.406678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:07.409404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=90 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:07.414137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.414614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.415045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.415729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.416177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.416594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.547733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:07.555403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-48c1170e-a093-46f2-97eb-efaa97e43032 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.153387 Oct 12 12:41:07.555965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 218/416] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:07 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:07.795779 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:07.796398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:07.802407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.802897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.803339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.804040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.804495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.804921 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.881827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f706cb9a-b0ad-46bc-94f4-e89e468e4024", "name": "network-vif-unplugged", "status": "completed", "tag": "bb5b2fee-ff37-496e-847f-922d0d418ff8"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:07.891678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:07.892155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:07.892584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:07.904317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] Creating event network-vif-unplugged:bb5b2fee-ff37-496e-847f-922d0d418ff8 for instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 on hv-cinder-81268 Oct 12 12:41:07.913325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-9ea9ff0c-d3f1-4094-b3b7-838cac7a6fbb req-f837b84a-0089-4138-b8b9-3c398a6ebec7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035083 Oct 12 12:41:07.914141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 219/417] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:07 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:07.935217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:07.943829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:07.945308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:07.946443 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0f63f27f-cd1d-45b5-9585-fcd1c95b8ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.155148 Oct 12 12:41:07.947046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 199/418] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:07 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:08.180956 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:08.181653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:08.187795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.188274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.188709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:08.189391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.189846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.190317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:08.317124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:08.325377 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-588c8c82-8be7-4874-aecd-f3ab23fa11a5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.148722 Oct 12 12:41:08.325957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 220/419] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:08 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:08.579746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:08.580353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:08.586705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.587221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.592417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:08.592417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.592417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.592417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:08.715807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:08.723490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f8d1a6d7-cade-4d14-8435-2360a5acaefe tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1503 microversion: 2.1 time: 0.147594 Oct 12 12:41:08.724470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 200/420] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:08 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:08.972679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:08.973312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:08.979918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.980401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.981335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:08.982818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:08.982818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:08.983058 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.111407 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:09.120386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:09.122434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:09.123590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-638add82-be2a-47ac-b224-59621287efc8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.154928 Oct 12 12:41:09.124144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 221/421] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:08 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:09.348372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:09.349244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:09.355395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:09.356343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:09.356777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.357689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:09.358186 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:09.358641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.506202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:09.514427 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5f691692-be37-476d-9d75-80e465d16d50 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.169846 Oct 12 12:41:09.515201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 201/422] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:09 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:09.746475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:09.746993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:09.752811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:09.753284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:09.753708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.754417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:09.754860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:09.755273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.892525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:09.901425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7c98848c-5f3b-44d5-821a-2179a063abf4 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1461 microversion: 2.1 time: 0.159137 Oct 12 12:41:09.902189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 222/423] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:09 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1461 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:09.938183 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f706cb9a-b0ad-46bc-94f4-e89e468e4024", "name": "network-vif-deleted", "tag": "bb5b2fee-ff37-496e-847f-922d0d418ff8"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:09.954514 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:09.955225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:09.955835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:09.968282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] Creating event network-vif-deleted:bb5b2fee-ff37-496e-847f-922d0d418ff8 for instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 on hv-cinder-81268 Oct 12 12:41:09.973417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-196d5f39-4f40-43d6-a9a6-144189b534c6 req-bbca1ef4-d569-45a7-9d95-8bb0a8191e53 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038933 Oct 12 12:41:09.974057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 202/424] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:10.149115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:10.149703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:10.156651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.157136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.157561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.158279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.158725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.159137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.443813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:10.453085 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:10.454568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:10.455752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1aec3bcf-079f-4970-87c4-b405c9ff2195 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.310941 Oct 12 12:41:10.456305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 223/425] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:10 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:10.538264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:10.538975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:10.545716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.546230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.546862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.547921 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.548605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.549034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.713488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:10.721571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a2388dce-8432-40e5-974a-e3cd227f682d tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.187567 Oct 12 12:41:10.722538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 203/426] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:10 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:10.926990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:10.927598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:10.933420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.934065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.934352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.935043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.935488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.935905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.967417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:10.967903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:10.968449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:10.968886 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lazy-loading 'fault' on Instance uuid f706cb9a-b0ad-46bc-94f4-e89e468e4024 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:11.012654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:11.020664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-adee8c8a-a43c-41b8-a96d-f73eea278e22 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 200 len: 1303 microversion: 2.1 time: 0.097544 Oct 12 12:41:11.021258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 224/427] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:10 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 1303 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:11.482240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:11.482933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:11.489632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:11.490223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:11.490722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:11.491482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:11.492002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:11.492584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:11.635277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:11.644708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:11.646198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:11.650450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b89f6914-5a84-464d-a9ef-50cde7cf0f5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1752 microversion: 2.20 time: 0.170920 Oct 12 12:41:11.650450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 204/428] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:11 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:11.745053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:11.745668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:11.752900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:11.753763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:11.753885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:11.754508 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:11.754956 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:11.755381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:11.890794 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:11.898522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d529ae87-696a-499f-9af7-3dbca57f9739 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.157684 Oct 12 12:41:11.899086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 225/429] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:11 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:12.049109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:12.050398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: f706cb9a-b0ad-46bc-94f4-e89e468e4024] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:12.055701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.056176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.056664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.057398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.057843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.058340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.072415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] HTTP exception thrown: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Request method failure captured: Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 HTTP/1.1 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrW508AGTxNvYIv_iEoTbM5fBSPBO6KRQH4cQD0KRQ3uK5G_hGahmrnJNKfu4B_n-rhfpG8cfIM6wAKNOCwkXDBkJFUK6fBbzDaJkyJhl6BB1_hw3XxVATjyPOxb3hKlqayQSDZtne4wocLH_6xKm_BmX85JAz57WdKokkR9ac4AvYg Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 827d3a5990a940049bcb35a219efdef3 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:41:12.074085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_827d3a5990a940049bcb35a219efdef3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 827d3a5990a940049bcb35a219efdef3 Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesActionsTest-1721169646-project Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: c96f2271cf394de1a15fcdfe3d62860a Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesActionsTest-1721169646-project Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. Oct 12 12:41:12.075801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'f706cb9a-b0ad-46bc-94f4-e89e468e4024'} Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:41:12.079802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. Oct 12 12:41:12.081714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:12.087061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Returning 404 to user: Instance f706cb9a-b0ad-46bc-94f4-e89e468e4024 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:41:12.087061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-79513dc8-1ebe-474d-a47f-15da9f0acdf2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024" status: 404 len: 111 microversion: 2.1 time: 0.030485 Oct 12 12:41:12.087061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 205/430] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:12 2022] GET /compute/v2.1/servers/f706cb9a-b0ad-46bc-94f4-e89e468e4024 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:41:12.180480 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-100541988", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "networks": [{"uuid": "32bd4761-1cf3-457f-afa4-3d358a5f2bd3"}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:12.233851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] validate_networks() for [('32bd4761-1cf3-457f-afa4-3d358a5f2bd3', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:41:12.569103 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:41:12.569519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:41:12.570175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:41:12.570585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:41:12.570992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:41:12.579700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.589257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.589257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.589257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.589257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.589619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.598802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Getting quotas for project 827d3a5990a940049bcb35a219efdef3. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:41:12.602762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Getting quotas for user c96f2271cf394de1a15fcdfe3d62860a and project 827d3a5990a940049bcb35a219efdef3. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:41:12.614231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:41:12.616523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:41:12.673109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:12.673718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:12.680130 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.680610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.681038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.681716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.682994 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.682994 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.768535 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-12b53b16-b9d8-4dcf-bdf7-5440de8fe229 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.591883 Oct 12 12:41:12.773973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 226/431] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:41:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:41:12.781238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fa25999d-d7ea-466f-abbf-4f625f7422f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:12.782122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fa25999d-d7ea-466f-abbf-4f625f7422f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:12.816262 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:12.834609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:12.836260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:12.837592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9d32e766-c592-408d-b934-b1a4ef314131 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.168369 Oct 12 12:41:12.838272 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 206/432] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:12 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:12.846996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fa25999d-d7ea-466f-abbf-4f625f7422f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:12.854792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fa25999d-d7ea-466f-abbf-4f625f7422f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1213 microversion: 2.1 time: 0.078166 Oct 12 12:41:12.857741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 227/433] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:12 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:12.920302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:12.920904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:12.926944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.927425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.927854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.928546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:12.928987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:12.929405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:12.933558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:13.061283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:13.068910 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7f945970-491c-45c7-bb52-d4dcd9851873 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.152342 Oct 12 12:41:13.069478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 207/434] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:12 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:13.864065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:13.864659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:13.871329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:13.871809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:13.872261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:13.872937 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:13.873379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:13.873798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:13.876529 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:13.877144 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:13.884033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:13.884515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:13.884946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:13.885635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:13.886125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:13.886548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:13.945687 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:13.953593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a400b705-6f8f-417a-a7e6-660759f506ae tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1217 microversion: 2.1 time: 0.080922 Oct 12 12:41:13.954197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 208/435] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:13 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1217 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:14.001991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:14.010688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:14.012137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:14.013280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f53e91ff-4114-4202-9064-b75eaf07d7ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.153099 Oct 12 12:41:14.013842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 228/436] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:13 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:14.092201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:14.092802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:14.098768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:14.099241 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:14.099751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:14.100430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:14.100876 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:14.101294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:14.227042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:14.234536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a537c48c-6e90-4f43-aae7-d617724f6ae3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.146650 Oct 12 12:41:14.235092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 209/437] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:14 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:14.976607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:14.977215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:14.984966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:14.990482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:14.990482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:14.990482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:14.990482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:14.990939 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:14.991938 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:15.039108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:15.039719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:15.047778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:15.047778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:15.047778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:15.048433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:15.048877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:15.049535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:15.071118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:15.082150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1bfe0ea2-49ab-4a0a-8b7b-dd234dfc653b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1217 microversion: 2.1 time: 0.109378 Oct 12 12:41:15.082724 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 229/438] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:14 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1217 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:15.199446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:15.208158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:15.209605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:15.210789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9b10c422-c5f1-4cdd-91de-bd61ce67daf2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.175841 Oct 12 12:41:15.211347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 210/439] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:15 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:15.256561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:15.257175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:15.263219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:15.264656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:15.264656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:15.264857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:15.265270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:15.265696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:15.556637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:15.565982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-42b857a2-9805-417f-8195-dbeed04c2078 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1270 microversion: 2.1 time: 0.313216 Oct 12 12:41:15.569843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 230/440] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:15 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1270 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:16.109042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:16.109827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:16.124132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.124132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.124132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.124132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.124449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.124449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.191761 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:16.200600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-372d5ae6-4dee-4520-9cb1-d22da6cd3a2a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1265 microversion: 2.1 time: 0.098954 Oct 12 12:41:16.201174 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 211/441] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:16 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:16.235966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:16.236629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:16.243425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.243937 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.244635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.245350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.245798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.246418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.375249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:16.383658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:16.385220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:16.386388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ba173d49-8180-4378-8bcf-a73467ffebc5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.154471 Oct 12 12:41:16.390513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 231/442] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:16 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:16.589583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:16.590237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:16.596227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.596704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.597170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.597845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:16.598314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:16.598732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:16.723944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:16.732167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-16751048-e7c6-476a-bdbc-184e07c84a25 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.146669 Oct 12 12:41:16.732706 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 212/443] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:16 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:17.226007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:17.226621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:17.233050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.233533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.233984 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.234669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.235120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.235541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.294637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:17.301999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-32192bec-e43a-495e-a370-5d6a0325989e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1265 microversion: 2.1 time: 0.079806 Oct 12 12:41:17.302560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 232/444] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:17 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:17.411695 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:17.412243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:17.419114 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.419596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.420031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.420720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.421199 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.421619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.550079 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:17.557230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:17.558758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:17.560516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2090b851-d100-4790-b3d8-a1187899a11f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.152774 Oct 12 12:41:17.561070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 213/445] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:17 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:17.755992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:17.756599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:17.762549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.767842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.767842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.767842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:17.767842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:17.768266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:17.892645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:17.900315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-08e6407f-46e1-47b2-a8f7-3ed366c769d5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.148154 Oct 12 12:41:17.909226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 233/446] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:17 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:18.325478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:18.326048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:18.332057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.332533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.332958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:18.333633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.334108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.334526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:18.393924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:18.401305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-01f9d8a3-2dd3-4d89-a18c-79e4605890e8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1265 microversion: 2.1 time: 0.080147 Oct 12 12:41:18.401867 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 214/447] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:18 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:18.585367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:18.585913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:18.592322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.592801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.593234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:18.593920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.594393 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.594813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:18.720626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:18.729203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:18.730696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:18.732364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-03c949be-894a-4a9a-b7d4-040e5581c337 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.150961 Oct 12 12:41:18.732929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 234/448] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:18 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:18.925474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:18.925474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:18.927097 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:18.931712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.932190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.932621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:18.933300 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:18.933749 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:18.934867 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:19.064574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:19.072555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-70db7613-c653-4a4d-8312-8ea825cf3b6a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.152463 Oct 12 12:41:19.073124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 215/449] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:18 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:19.424585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:19.425193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:19.431047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:19.431523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:19.431946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:19.432621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:19.433064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:19.433479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:19.492906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:19.502568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-57e6c1dc-ac86-4b33-9d77-69c55642ceaf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1265 microversion: 2.1 time: 0.080105 Oct 12 12:41:19.502568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 235/450] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:19 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1265 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:19.757993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:19.758660 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:19.765162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:19.765648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:19.766127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:19.766821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:19.767279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:19.767707 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:19.905014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:19.912260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:19.913772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:19.915361 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d54e0f8d-c18a-4525-8d53-07fa3a717b5d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.161851 Oct 12 12:41:19.915915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 216/451] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:19 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:20.095035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:20.096799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:20.105224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.105804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.107219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:20.108123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.108776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.109559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:20.299418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:20.308227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-36868d5b-8c30-4509-9827-c435043fc6ec tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.217008 Oct 12 12:41:20.309875 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 236/452] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:20 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:20.524096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:20.524911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:20.532489 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.533225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.533667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:20.534398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.535278 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.535874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:20.630268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:20.641742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a532c5eb-4fa2-498e-b765-a7cc9ddb3fa3 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1271 microversion: 2.1 time: 0.121547 Oct 12 12:41:20.645189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 217/453] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:20 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1271 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:20.941977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:20.942867 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:20.949702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.950989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.951571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:20.952426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:20.953022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:20.953608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:21.100843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:21.110724 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:21.112182 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:21.113337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8ae59355-0fab-419a-8c83-0d739d0e7109 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.175879 Oct 12 12:41:21.113900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 237/454] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:20 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:21.331878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:21.332405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:21.338978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:21.339509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:21.339941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:21.341163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:21.341615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:21.342061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:21.476870 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:21.485040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4ca4a23f-b03a-45aa-8ad9-93104ac6dade tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.157125 Oct 12 12:41:21.485600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 218/455] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:21 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:21.669253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:21.669777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:21.676006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:21.676491 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:21.676921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:21.677612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:21.678123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:21.678540 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:21.813657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:21.821354 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f1da44f8-a975-47f2-9b9e-c89d8cf532a8 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.156534 Oct 12 12:41:21.821954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 238/456] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:21 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:22.141057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:22.141680 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:22.148025 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.148501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.148928 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.149648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.150137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.150556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.288476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:22.297799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:22.299308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:22.300483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-02376366-bc3f-456b-a1dc-dbabfd8141f0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.163574 Oct 12 12:41:22.301037 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 219/457] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:22 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:22.507706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:22.508223 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:22.515255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.515723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.516146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.516819 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.517262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.517710 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.589378 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:22.668490 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:22.676788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d8399c4c-8dde-49eb-8472-7e45557c0dc5 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.172985 Oct 12 12:41:22.679623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 239/458] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:22 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:22.845088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:22.846019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:22.852934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.853716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.854458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.855418 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:22.856315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:22.856938 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:22.988820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:22.997344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0407ef3f-bbb0-438c-863c-ec91b1468271 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.155943 Oct 12 12:41:22.997920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 220/459] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:22 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:23.330887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:23.330887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:23.330887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=8 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:23.335801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:23.336331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:23.336857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:23.337559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:23.338043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:23.338473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:23.699640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:23.700431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:23.704881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:23.712261 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:23.712746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:23.713180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:23.713871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:23.714346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:23.716989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:23.722654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:23.724102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:23.725269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-333e8401-6a14-4a10-8fd6-7479186224e5 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.403055 Oct 12 12:41:23.725825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 240/460] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:23 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:23.875785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:23.884652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f008fda5-9559-4b91-a09e-47240cd24c03 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.189231 Oct 12 12:41:23.885586 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 221/461] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:23 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:24.020702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:24.021360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:24.027677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.028931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.029625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.030566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.031297 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.031871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.164226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:24.171982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-919346f3-5e74-4b4e-a75c-fbf7c7501cbf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.155214 Oct 12 12:41:24.172546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 241/462] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:24 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:24.758350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:24.759046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:24.765275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.765764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.766240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.766932 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.767391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.767816 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.911534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:24.912151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:24.918414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.919188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.926167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.926943 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:24.927417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:24.927847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:24.935663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:24.964904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:24.967259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:24.968522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-329d1617-871a-4892-9601-03230766c1e0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.214135 Oct 12 12:41:24.969093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 222/463] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:24 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:25.131306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:25.139688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c84843d9-5860-46d5-b220-7d3eaf3e7f6f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.234294 Oct 12 12:41:25.142026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 242/464] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:24 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:25.195451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:25.196064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:25.203060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:25.203548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:25.203982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:25.204670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:25.205141 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:25.205558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:25.338728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:25.342198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:25.347087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8f72254c-26bd-4f18-ad1d-8034d0eb0847 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.155565 Oct 12 12:41:25.347732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 223/465] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:25 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:25.999836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:26.000586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:26.007347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.008098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.008685 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.009551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.011285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.011870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.154558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:26.162841 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:26.163454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:26.163614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:26.165099 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:26.166305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c14bfce9-367c-4ff6-9f8d-6a4516bfab72 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.170367 Oct 12 12:41:26.166865 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 243/466] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:25 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:26.183536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.190117 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.191637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.192456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.193149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.193801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.337171 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:26.346897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-191feb4d-24fb-48ce-9f18-18e91d7d826c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.187711 Oct 12 12:41:26.363914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 224/467] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:26 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:26.369084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:26.370026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:26.377466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.378141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.378748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.379598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:26.380198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:26.380727 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:26.525256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:26.533674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cfdd0093-8805-460c-94bb-1b00c88261a9 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.168623 Oct 12 12:41:26.534277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 244/468] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:26 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:27.193212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:27.194728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:27.202404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.202997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.203506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.204285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.204807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.205457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.349010 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:27.359168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:27.360289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:27.361501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3b36497e-1e01-41f3-abd5-b4fd7125f80f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.172219 Oct 12 12:41:27.362086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 225/469] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:27 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:27.371137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:27.372348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:27.379134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.379894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.380530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.381435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.382118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.382738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.541879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:27.550523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:27.556765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fc7dcea3-5f2b-460a-8449-d6a1ce821f56 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.189651 Oct 12 12:41:27.557827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 245/470] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:27 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:27.571600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:27.572259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:27.579314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.581643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.581643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.581643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:27.581643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:27.582083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:27.730057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:27.740289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-82ab54a9-e029-40dc-938a-26d0298b792b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.186495 Oct 12 12:41:27.740978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 226/471] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:27 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:28.393296 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:28.394032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:28.400831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.401577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.402199 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.403186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.403942 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.404524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.454628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:28.455368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:28.462416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.462900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.463351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.464044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.464490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.464907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.551107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:28.560610 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:28.562070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:28.563239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-93fefcaa-01dd-4b16-8179-8a0b51eb1243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.175526 Oct 12 12:41:28.563832 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 246/472] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:28 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:28.583440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:28.584209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:28.591048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.591762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.591973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.592679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.593345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.593776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.619910 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lazy-loading 'services' on Instance uuid 9785f5a1-07ef-4a37-bc0d-e921e203cc1f {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:28.754849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:28.765489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-98eb892f-a09b-42ec-bb04-1ce99dd0a58e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.187940 Oct 12 12:41:28.766666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 247/473] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:28 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:28.771158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:28.771763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:28.778793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.779326 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.780640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.780640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:28.780948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:28.781292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:28.909874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7d8da192-1a82-4193-9971-2208a688e21f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f/os-volume_attachments/cb3326c0-8f91-4185-9566-566fb051452f" status: 202 len: 0 microversion: 2.1 time: 0.459226 Oct 12 12:41:28.911405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 227/474] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:41:28 2022] DELETE /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f/os-volume_attachments/cb3326c0-8f91-4185-9566-566fb051452f => generated 0 bytes in 462 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:41:28.931547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:28.939768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ac5a9a9c-0af1-47a6-acd5-66cde88928ee tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.172601 Oct 12 12:41:28.940374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 248/475] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:28 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:29.591237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:29.591920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:29.598568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.599052 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.599486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:29.600184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.600639 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.601061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:29.743221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:29.752941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:29.754455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:29.755613 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b35e2b95-965b-4267-a5cb-8b6441aade8d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.170361 Oct 12 12:41:29.756165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 228/476] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:29 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:29.788993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:29.789709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:29.796918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.797483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.798010 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:29.798780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.799236 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.799656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:29.934784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:29.942392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-50b86a1a-8f69-42c3-b6ff-a4634334b1de tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.157559 Oct 12 12:41:29.942947 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 249/477] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:29 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:29.963979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:29.964675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:29.971557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.972139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.972643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:29.973280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:29.973728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:29.974180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:30.332165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:30.339832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-29d315b8-2398-466c-bff5-929757335420 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.379632 Oct 12 12:41:30.340395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 229/478] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:29 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:30.780945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:30.781682 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:30.787601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:30.788076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:30.788505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:30.789190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:30.789761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:30.790067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:30.964984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:30.966244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:30.972723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:30.973209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:30.973644 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:30.974366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:30.974824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:30.975254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:30.990550 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:31.000125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:31.001581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:31.002790 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-58415804-653c-47a7-ab5a-5913aa080a97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.225966 Oct 12 12:41:31.003349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 250/479] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:30 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:31.107268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:31.116393 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c44c9bc5-2a44-4deb-b538-444a91df4017 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.154133 Oct 12 12:41:31.128199 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 230/480] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:30 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:31.362500 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:31.363112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:31.369249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:31.370008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:31.370483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:31.371166 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:31.372120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:31.372548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:31.406308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "08abde20-e25f-4e3f-8644-4ddbdf09bef6", "tag": "10aac0bc-9a29-4212-9287-354ce2e70964"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:31.415949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:31.416614 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:31.417220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:31.427794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] Creating event network-changed:10aac0bc-9a29-4212-9287-354ce2e70964 for instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 on hv-cinder-81268 Oct 12 12:41:31.432555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-4af40b3f-3b30-47af-a536-e39cc3ba4e53 req-4f5774b9-e5cc-449d-9227-64081a6f213f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030011 Oct 12 12:41:31.433139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 231/481] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:31.489789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:41:31.490006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Wed Oct 12 12:41:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 (ip 10.222.0.44) !!! Oct 12 12:41:31.559822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:31.567533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0a4768e8-3bd2-4c57-a2af-a546a1dfc857 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.208928 Oct 12 12:41:31.568096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 251/482] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:31 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:32.031394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:32.032111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:32.038661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.039132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.039556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.040230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.040672 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.041086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.138670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:32.140199 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:32.146838 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.147325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.147755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.148453 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.148898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.149344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.196576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:32.206183 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:32.207666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:32.208851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1e9231d2-3247-488e-a144-b022e069a3e9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.182201 Oct 12 12:41:32.210842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 232/483] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:32 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:32.315812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:32.323417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7745d397-e637-47c0-8f72-51e5f107fb91 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.189245 Oct 12 12:41:32.324011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 252/484] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:32 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:32.589580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:32.590154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:32.596365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.596840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.597270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.597986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:32.598439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:32.598854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:32.722593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:32.730204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4c4db6cd-5658-4721-9b20-e12d1403f79d tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.144419 Oct 12 12:41:32.730773 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 233/485] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:32 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:33.240997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:33.241659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:33.249073 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.249609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.250113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.251316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.251773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.252191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.346225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:33.347012 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:33.354055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.354547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.354982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.355676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.356872 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.357303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.433416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:33.442593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:33.444265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:33.449796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4d5f2e2f-56ca-4347-baf0-f14005f91788 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.208739 Oct 12 12:41:33.449796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 253/486] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:33 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:33.496471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:33.504045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-77c95775-dca2-4abf-b4ec-699547f39afb tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.162192 Oct 12 12:41:33.504607 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 234/487] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:33 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:33.752870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:33.753418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:33.759417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.759896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.760323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.761008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:33.761452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:33.761868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:33.892131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:33.899623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-38f3e813-9c65-4e40-9dcb-13b0a144491a tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.150743 Oct 12 12:41:33.900188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 254/488] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:33 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:34.328500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:34.328989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:34.334818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.335297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.335727 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.336430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.336877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.337293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.361668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:41:34.470998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:34.471601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:34.478012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.478494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.478921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.479638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.480091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.480517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.573020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3076fd34-fb22-46f7-86b9-1de483a8c8ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 204 len: 0 microversion: 2.1 time: 0.248514 Oct 12 12:41:34.573640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 235/489] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:41:34 2022] DELETE /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:41:34.582175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:34.587227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:34.588829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.589520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.590186 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.591217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.591863 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.592462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.611491 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:34.620615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:34.622762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:34.623934 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-13e90802-723f-47e0-a20c-12abe0056f46 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.157004 Oct 12 12:41:34.624503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 255/490] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:34 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:34.629290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:34.629907 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:34.635872 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.636360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.636826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.637519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.638007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.638435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.751907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:34.759874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7d5dd9aa-2ac1-4e50-94cf-0fb91f0c7a4c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.181975 Oct 12 12:41:34.760537 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 236/491] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:34 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:34.783858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:34.791751 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-948e572e-594f-4748-b5b4-65d1097b7ab2 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1513 microversion: 2.1 time: 0.166022 Oct 12 12:41:34.792326 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 256/492] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:34 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:34.923716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:34.924243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:34.931251 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.932107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.932708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:34.933563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:34.934209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:34.934948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.060211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.068001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0e31580f-a1e0-408e-996b-9453e456c4f2 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.148801 Oct 12 12:41:35.068583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 237/493] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:34 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:35.652922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:35.653556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:35.660534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.661017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.661451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.662174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.662625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.663045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.782264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:35.782855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:35.789404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.789880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.790346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.791041 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.791487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.791900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.793102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.802400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.803841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.804986 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-da0eb6a5-35b7-4c67-b506-4f3625791f79 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.155977 Oct 12 12:41:35.805538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 257/494] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:35 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:35.814210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:35.814809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:35.820551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.821029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.821450 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.822162 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:35.822608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:35.823023 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:35.928762 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.934229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:35.941975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-481012b7-aae1-4211-b493-7fabeb003020 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.163878 Oct 12 12:41:35.942660 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 238/495] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:35 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:35.952620 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:35.960580 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-596c46d5-0398-4cd6-9ffd-bc74f66e482b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1513 microversion: 2.1 time: 0.149940 Oct 12 12:41:35.961152 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 258/496] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:35 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:36.093176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:36.093801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:36.100433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.100920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.101355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.102076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.103885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.103885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.133787 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "name": "network-vif-plugged", "status": "completed", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:36.139882 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:36.145552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.146074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.146515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.158273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] Creating event network-vif-plugged:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:41:36.163320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-6499ee04-6177-479e-a50b-edc6c880ae37 req-21509ad4-6d1f-4550-bde5-33fbe58b99a4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033191 Oct 12 12:41:36.163918 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 259/497] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:36.245665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:36.245665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-597410fc-1cf7-4eaf-b957-e68b2e8db3f7 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.158017 Oct 12 12:41:36.246281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 239/498] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:36 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:36.830922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:36.831650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:36.838225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.838707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.839139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.839827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.840277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.840698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.965797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:36.966439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:36.973007 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.973502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.973944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:36.974638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:36.975092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:36.975512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.086964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.096425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.098053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.099226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-60bf89cf-6229-43cc-bb0a-d5503afc5312 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.273460 Oct 12 12:41:37.099997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 260/499] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:36 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:37.104546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:37.105140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:37.112159 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:37.112927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:37.113458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.113799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.114729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:37.115387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:37.115993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.121766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-42e49546-b488-4f16-8540-7af18373c990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.160327 Oct 12 12:41:37.130313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 240/500] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:36 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:37.267972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:37.268574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:37.274415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:37.274893 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:37.275318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.276001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:37.276448 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:37.276864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.328673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.336451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a351eed0-dbcd-4ed2-9238-aad97ee5ac29 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1513 microversion: 2.1 time: 0.235323 Oct 12 12:41:37.337028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 261/501] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:37 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1513 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:37.411491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:37.419149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a1438a61-2cd2-4190-a0cd-2629ef6a0aba tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.154968 Oct 12 12:41:37.420240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 241/502] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:37 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:37.573125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9785f5a1-07ef-4a37-bc0d-e921e203cc1f", "name": "network-vif-deleted", "tag": "f08b5cba-5112-4013-8e2b-0f5f79411723"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:37.582443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:37.582910 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:37.583333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:37.593753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] Creating event network-vif-deleted:f08b5cba-5112-4013-8e2b-0f5f79411723 for instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f on hv-cinder-81268 Oct 12 12:41:37.598356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-d60bcd28-5334-4806-8697-ce11fa2d31bb req-1db4cd9a-236d-4e22-8451-8028bc52a296 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028787 Oct 12 12:41:37.598920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 262/503] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:38.126372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:38.126987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:38.133405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.133887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.134356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.135044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.135498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.135924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.145170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:38.145954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:38.152186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.152660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.153143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.153823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.154776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.155190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.271958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.281063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.282656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.283822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7303e074-a3c2-43a6-9e29-633f03bd3575 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.161489 Oct 12 12:41:38.284379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 242/504] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:38 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:38.297347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.300975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:38.305521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e039a29d-eadd-47bf-8f7a-07cc60bf800e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1258 microversion: 2.1 time: 0.165179 Oct 12 12:41:38.306120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 263/505] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:38 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:38.360134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:38.360743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:38.366673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.367153 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.367615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.368301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.368751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.369171 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.432592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.440871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-52891c62-7660-43bb-b2d9-e03f0c67b761 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1303 microversion: 2.1 time: 0.085024 Oct 12 12:41:38.441433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 243/506] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:38 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1303 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:38.442323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:38.442926 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:38.449318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.449713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.450178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.450889 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:38.451336 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:38.451752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:38.576304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:38.583797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-acee3e3d-f79b-4085-b1f1-ed0979e300cf tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.145306 Oct 12 12:41:38.584362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 264/507] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:38 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:39.309736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:39.310542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:39.317380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.317877 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.318341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.319070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.319482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.319903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.328399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:39.329011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:39.335385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.335873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.336314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.337005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.337462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.337885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.448887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.457430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.458915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.460169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6552bb35-fef3-4538-8c01-bf7d5dd59ea7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.154322 Oct 12 12:41:39.460728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 244/508] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:39 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:39.467122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.474804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:39.474965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-991be09e-ac6e-4a25-8d98-9eac89f8c809 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1442 microversion: 2.1 time: 0.150265 Oct 12 12:41:39.475355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 265/509] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:39 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1442 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:39.477888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:39.484438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.484914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.485338 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.486077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.486522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.486939 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.497434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:39.498077 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:39.503968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.504458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.504895 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.505585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.506103 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.506528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.517555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.518066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.518493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.518927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lazy-loading 'fault' on Instance uuid 9785f5a1-07ef-4a37-bc0d-e921e203cc1f {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:39.559265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.567224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5779a524-4cb0-40d6-9d49-1dd6dcbc817f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1308 microversion: 2.1 time: 0.096218 Oct 12 12:41:39.567792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 245/510] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:39 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1308 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:39.606454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:39.607139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:39.613587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.614077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.614511 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.615202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:39.615655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:39.616080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:39.637788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.646092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f36f47ae-6b37-4112-b73a-65e3a34bf3cc tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1442 microversion: 2.1 time: 0.152538 Oct 12 12:41:39.646661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 266/511] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:39 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1442 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:39.750125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:39.758110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6af221ff-43a7-4799-b6a5-38c4ea8c18af tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.155351 Oct 12 12:41:39.758922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 246/512] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:39 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:40.292843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08abde20-e25f-4e3f-8644-4ddbdf09bef6", "name": "network-vif-plugged", "status": "completed", "tag": "10aac0bc-9a29-4212-9287-354ce2e70964"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:40.302749 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.303220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.303639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.314476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] Creating event network-vif-plugged:10aac0bc-9a29-4212-9287-354ce2e70964 for instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 on hv-cinder-81268 Oct 12 12:41:40.319805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-c1d093df-7a5e-45dc-851f-fc69056f4a89 req-33c1b362-bb6b-49b4-8be3-1c4d347cc273 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030542 Oct 12 12:41:40.320396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 267/513] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:40.486055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:40.486670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:40.492983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.493501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.494047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.495005 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.495458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.495969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.592725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:40.593578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:40.600199 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.600813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.601347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.602175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.602849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.603344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.634795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:40.639632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.640118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.640549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.640997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lazy-loading 'fault' on Instance uuid 9785f5a1-07ef-4a37-bc0d-e921e203cc1f {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:40.646250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:40.650466 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:40.650466 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e1eaeae9-6dac-4971-8a6a-80ee35736c08 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.167356 Oct 12 12:41:40.651281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 247/514] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:40 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:40.705887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:40.713555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-228364dc-0a27-4ef7-9a94-e9f6bb350b23 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 200 len: 1308 microversion: 2.1 time: 0.126969 Oct 12 12:41:40.714369 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 268/515] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:40 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 1308 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:40.781259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:40.782272 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:40.789714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.790372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.790977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.791824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:40.792402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:40.792824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:40.942004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:40.950067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-99b876fc-2ebc-4229-bffb-f773860fad31 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.173179 Oct 12 12:41:40.950657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 248/516] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:40 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:41.676837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:41.677537 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:41.684272 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.684756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.685683 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:41.686405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.686861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.687289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:41.737121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:41.737650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: 9785f5a1-07ef-4a37-bc0d-e921e203cc1f] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:41.743711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.744196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.744871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:41.745574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.746175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.746608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:41.760026 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] HTTP exception thrown: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Request method failure captured: Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f HTTP/1.1 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrWoYIxSxzWc-TgnDT1nYzsemX6nePioh1QhaPsvXTarog_pW6Zwl5CZOKZep7Q_rNPPFb2Liqyjncq1z2vKqu9gkuJg-Jv-VbhT8u99G8oYtQmRzZiS3ey1OPMHkYvhwOHvcodUkCv4hXX48611npbH64v2LQr0k5a0nlKBUZ7Am3s Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 0c9f0d8dfa9544a9a9fec1c5dad43d74 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:41:41.761664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c9f0d8dfa9544a9a9fec1c5dad43d74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 0c9f0d8dfa9544a9a9fec1c5dad43d74 Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesSnapshotTestJSON-1571967228-project Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 07dec04c01264b90aa962053c6d1304a Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesSnapshotTestJSON-1571967228-project Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. Oct 12 12:41:41.763302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '9785f5a1-07ef-4a37-bc0d-e921e203cc1f'} Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:41:41.764211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. Oct 12 12:41:41.765638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:41.766943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Returning 404 to user: Instance 9785f5a1-07ef-4a37-bc0d-e921e203cc1f could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:41:41.766943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-06b57855-ce9b-4003-902a-e94afff83584 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f" status: 404 len: 111 microversion: 2.1 time: 0.029852 Oct 12 12:41:41.766943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 249/517] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:41 2022] GET /compute/v2.1/servers/9785f5a1-07ef-4a37-bc0d-e921e203cc1f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:41:41.902674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:41.912154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:41.913689 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:41.914922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-69b368be-4bea-48c8-9773-0102a21acd14 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.242151 Oct 12 12:41:41.915492 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 269/518] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:41 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:41.974133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:41.974756 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:41.980849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.981344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.981775 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:41.982708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:41.983159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:41.983739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:42.123663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:42.131531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ce340c48-0ccb-47ca-a90d-59bec841ad94 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.161538 Oct 12 12:41:42.143485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 250/519] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:41 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:42.145584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:42.155507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:42.155993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:42.156411 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:42.169165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] Creating event network-changed:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:41:42.174478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-2d8dda51-70db-4e78-bfe6-be6852c4b03f req-e2f66d08-ea31-4ccf-956e-16266e1965bc service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032434 Oct 12 12:41:42.176159 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 270/520] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:42.941172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:42.941778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:42.948666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:42.949152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:42.949587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:42.950310 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:42.950795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:42.951226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:43.086264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:43.095587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:43.097039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:43.098492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-adcad095-3549-43a0-8601-b572bb46e8be tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.161180 Oct 12 12:41:43.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 251/521] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:42 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:43.164657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:43.165276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:43.172016 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:43.172493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:43.172922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:43.173613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:43.174100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:43.174520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:43.306130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:43.313860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-59a3b5bc-8880-4d73-ad11-c95c8aaec16b tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.154002 Oct 12 12:41:43.314448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 271/522] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:43 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:44.123720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:44.124318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:44.130876 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:44.131358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:44.131790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:44.132483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:44.132933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:44.133350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:44.261668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:44.270807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:44.272263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:44.273485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a2f8d071-7d68-4800-adc6-e55f49ffe323 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.153892 Oct 12 12:41:44.274205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 252/523] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:44 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:44.336434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:44.336980 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:44.344188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:44.344678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:44.345111 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:44.345795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:44.346271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:44.346691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:44.475339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:44.483229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-17336099-51c3-42db-97eb-74d1b3278c1f tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.150721 Oct 12 12:41:44.483794 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 272/524] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:44 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:45.299589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:45.300198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.306692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.307173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.307605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.308295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.308743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.309164 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.400180 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:45.400743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.407566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.408214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.408484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.409447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.409892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.410639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.435487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0a57cc06-96c9-40a8-8689-64795198b0d4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/ips" status: 200 len: 151 microversion: 2.1 time: 0.039016 Oct 12 12:41:45.436229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 273/525] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:41:45 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/ips => generated 151 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:45.443553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:45.451939 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83d85b3a-9052-4dd5-8a57-1c99664d6957"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:45.457145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:45.457145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:45.457145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7ee33d2f-6ee6-476d-a291-3a43b35f2803 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.159506 Oct 12 12:41:45.457449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.457530 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 253/526] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:45 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:45.465276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.466030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.467151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.468177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.468785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.469367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.510073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:45.510904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.520062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.520802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.521067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.521836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.522271 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.522694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.555462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: POST /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/os-volume_attachments HTTP/1.1 Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 74 Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:41:45.557168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {"volumeAttachment": {"volumeId": "83d85b3a-9052-4dd5-8a57-1c99664d6957"}} Oct 12 12:41:45.558597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'server_id': 'e3a51ad5-ef04-4f25-961e-6705be7abc42', 'body': {'volumeAttachment': {'volumeId': '83d85b3a-9052-4dd5-8a57-1c99664d6957'}}} Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:45.559420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:45.561093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 400 to user: Invalid volume: volume 83d85b3a-9052-4dd5-8a57-1c99664d6957 is already attached to instances: 283eb4f3-2765-48cc-9bee-2178c185deca {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e0ac9670-23a8-4bc0-b824-6c01eb3ca960 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.113976 Oct 12 12:41:45.562370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 274/527] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:41:45 2022] POST /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Oct 12 12:41:45.568441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:45.569010 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.575880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.577123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.577444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.578165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.578608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.579186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.603963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:41:45.661436 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:45.669184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cc07d626-2f5c-4727-be71-1d9ccdf95607 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1313 microversion: 2.1 time: 0.165625 Oct 12 12:41:45.670345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 254/528] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:45 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:45.675017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9edf1037-676b-452d-9a0a-e7576faed1d6"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:45.677393 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.682991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.683465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.683895 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.684574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.685015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.686242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.760758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:45.913995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-96c12fca-9585-42a9-ab1d-92e3680c3afa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 204 len: 0 microversion: 2.1 time: 0.348738 Oct 12 12:41:45.915341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 275/529] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:41:45 2022] DELETE /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:41:45.925745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:45.926608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:45.932785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.933348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.933809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:45.934541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:45.934991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:45.935964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:46.069544 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:46.077294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-159cacc2-761c-4161-8b39-544fd4c1c30e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1682 microversion: 2.1 time: 0.155833 Oct 12 12:41:46.077852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 276/530] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:45 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:46.480581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:46.481202 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:46.487516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:46.488000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:46.488454 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:46.489140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:46.489589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:46.490034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:46.618261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:46.627251 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:46.628762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:46.630013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-08c6709a-2dc0-42f8-9b63-bfbc4bbfeeb0 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.153340 Oct 12 12:41:46.630576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 277/531] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:46 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:41:46.692348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:46.692961 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:46.698897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:46.699373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:46.699805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:46.700487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:46.701442 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:46.701864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:46.829517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:46.837212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-99262b30-14d7-4e9a-8d17-e174243c610c tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1497 microversion: 2.1 time: 0.148641 Oct 12 12:41:46.837770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 278/532] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:46 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1497 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:47.101670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:47.102314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:47.108746 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.109225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.109655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.110358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.110805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.111226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.237524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:47.246963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-677f6d22-4440-4e15-bad2-51e8dbf00cd4 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1682 microversion: 2.1 time: 0.149156 Oct 12 12:41:47.247537 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 279/533] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:47 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:47.549163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "name": "network-vif-plugged", "status": "completed", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:47.559668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.560640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.561056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.564995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:47.572196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] Creating event network-vif-plugged:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:41:47.577579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-17c616f8-936d-4022-9b29-d15b2ea2427a req-259ef2c9-d39f-46fa-a286-63af9f47b08f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032285 Oct 12 12:41:47.578185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 280/534] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:47.656859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:47.657649 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:47.664510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.664995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.665528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.666244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.666692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.667110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.804249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:47.815355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:47.816796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:47.817976 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0e29c50f-9ed9-437b-b84c-a59de6d2e098 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.166201 Oct 12 12:41:47.818703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 281/535] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:47.839251 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:47.839732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:47.845796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.846315 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.846747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.847419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:47.847864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:47.848298 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:47.872585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:41:47.885504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3b876957-12f6-4249-97c5-3ffcd4dc0370 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.213941 Oct 12 12:41:47.886125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 255/536] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:41:45 2022] POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 194 bytes in 2215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:48.173117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d4912b95-b196-4591-b301-51a7397cc188 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "DELETE /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 204 len: 0 microversion: 2.1 time: 0.337493 Oct 12 12:41:48.174044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 282/537] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:41:47 2022] DELETE /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 12:41:48.182752 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:48.183524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:48.193364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.193364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.193364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:48.193364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.193809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.194289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:48.270812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:48.271510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:48.277807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.278356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.278793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:48.280113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.280568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.280991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:48.344429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:48.352317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c4f50487-6468-487c-b0d3-04c46a81d1fc tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1503 microversion: 2.1 time: 0.173821 Oct 12 12:41:48.352888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 256/538] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:48 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1503 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:48.532186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:48.539743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-14e02766-6d14-4263-8ae8-c61c4a20e0ab tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1682 microversion: 2.1 time: 0.273220 Oct 12 12:41:48.540322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 283/539] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:48 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1682 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:48.844518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:48.845298 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:48.851571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.852062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.852503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:48.853203 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:48.853655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:48.854109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.013962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:49.013962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:49.017184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:49.018647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cd849bca-fba4-48ad-a7c7-2e3f8f2e4cf1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.178697 Oct 12 12:41:49.019355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 257/540] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:48 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:49.377863 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:49.379245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:49.386239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:49.386980 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:49.388222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.388478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:49.389059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:49.389552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.433747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3a51ad5-ef04-4f25-961e-6705be7abc42", "name": "network-vif-deleted", "tag": "b3a343e1-04ff-45b8-a712-621f39f630db"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:49.447785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:49.448612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:49.449252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.462247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] Creating event network-vif-deleted:b3a343e1-04ff-45b8-a712-621f39f630db for instance e3a51ad5-ef04-4f25-961e-6705be7abc42 on hv-cinder-81268 Oct 12 12:41:49.468273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-b2629c5f-e015-4325-b273-ba1e4068e776 req-98623bef-c67f-49b5-a8a6-e02493713c84 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039342 Oct 12 12:41:49.469380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 258/541] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:49.534322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:49.542246 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9b5f528a-c1c4-4906-9015-b2fa7be45511 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1503 microversion: 2.1 time: 0.168641 Oct 12 12:41:49.542822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 284/542] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:49 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:49.563312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:49.564033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:49.570442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:49.571547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:49.571547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.572233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:49.572750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:49.573235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:49.641390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:49.650134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ebcac16a-1111-45a8-b4ab-a2e4e9802f45 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1615 microversion: 2.1 time: 0.091045 Oct 12 12:41:49.650816 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 259/543] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:49 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:50.044224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:50.045920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:50.053847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.055241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.056025 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.058012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.059425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.060736 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.235822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:50.244787 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:50.246519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:50.247715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-22af8527-5afd-4244-a7c3-70b4a4cab0b6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.207775 Oct 12 12:41:50.249030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 285/544] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:50 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:50.565227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:50.565852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:50.568399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:50.573414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.573897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.574367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.575139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.575596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.576576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.674561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:50.675195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:50.682437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.689106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.689106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.689106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:50.689106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:50.689559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:50.731451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:50.740057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2582b884-4524-42fa-b21a-516da9863959 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1503 microversion: 2.1 time: 0.178593 Oct 12 12:41:50.741033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 260/545] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:50 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1503 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:50.753480 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:50.762245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b9635823-507d-4f10-bdad-71367a59bdfe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1615 microversion: 2.1 time: 0.091882 Oct 12 12:41:50.762845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 286/546] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:50 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1615 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:51.273503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:51.274145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:51.280674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.281166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.281580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.282297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.282753 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.283479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.412656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:51.421894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:51.423610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:51.425025 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9bf2b188-be3d-4fc5-9606-72216fb11b19 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.155417 Oct 12 12:41:51.426295 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 261/547] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:51 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:51.763584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:51.764201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:51.770803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.771354 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.771789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.772473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.772958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.773393 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.786026 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:51.786632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:51.792902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.794414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.794414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.795290 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:51.795419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:51.795839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:51.861852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:51.869679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-02dbb313-6d75-4c1f-b52f-d2bd902e1934 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1326 microversion: 2.1 time: 0.087781 Oct 12 12:41:51.871214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 262/548] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:51 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1326 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:51.905388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:51.913038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-24e291ed-e77d-42dd-9c31-ff9639447090 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1503 microversion: 2.1 time: 0.153500 Oct 12 12:41:51.913600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 287/549] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:51 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1503 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:52.357986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1128042710", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "networks": [{"uuid": "28a68333-5806-4ed4-b231-101d2ee13320"}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:52.412451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] validate_networks() for [('28a68333-5806-4ed4-b231-101d2ee13320', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:41:52.463169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:52.464603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:52.474037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.475629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.476293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.477076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.477626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.478429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.629210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:52.638264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:52.639707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:52.641658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-db55311e-bbdc-4846-be15-56bbd73eb6d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.192728 Oct 12 12:41:52.642763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 288/550] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:52 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:52.649599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "08abde20-e25f-4e3f-8644-4ddbdf09bef6", "name": "network-vif-deleted", "tag": "10aac0bc-9a29-4212-9287-354ce2e70964"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:41:52.659688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.660308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.660833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.672543 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] Creating event network-vif-deleted:10aac0bc-9a29-4212-9287-354ce2e70964 for instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 on hv-cinder-81268 Oct 12 12:41:52.677569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-04501a7b-a8d3-462a-80a5-2c212e79d2e4 req-39304bfc-6e0a-4052-b1fc-f4605e4b8b7a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033375 Oct 12 12:41:52.678426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 289/551] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:41:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:52.780695 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:41:52.781104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:41:52.781570 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:41:52.783305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:41:52.783305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:41:52.791779 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.792311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.792669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.793384 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.793830 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.794292 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.811384 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Getting quotas for project 0c9f0d8dfa9544a9a9fec1c5dad43d74. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:41:52.815327 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Getting quotas for user 07dec04c01264b90aa962053c6d1304a and project 0c9f0d8dfa9544a9a9fec1c5dad43d74. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:41:52.825990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:41:52.828288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:41:52.894608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:52.895233 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:52.902024 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.902501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.902941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.903605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.904574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.904990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.935699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.937082 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.937686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.938239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'fault' on Instance uuid e3a51ad5-ef04-4f25-961e-6705be7abc42 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:52.953030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b1ba2c9d-af93-4af2-914a-ae3fc908e891 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.599613 Oct 12 12:41:52.959971 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 263/552] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:41:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 601 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:41:52.963526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:52.964215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:52.986890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.987398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.987852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:52.988568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:52.989033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:52.989469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:53.003815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.011995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-566afd04-0731-4c35-8add-a4b45ecab7e8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1331 microversion: 2.1 time: 0.122035 Oct 12 12:41:53.012561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 290/553] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:52 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1331 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:53.034443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-118609c8-4796-425e-b479-ccff14b84099 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:53.035341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-118609c8-4796-425e-b479-ccff14b84099 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:53.075310 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.088385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-035b3efd-0e52-4e65-b6ee-b042c113339e tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1461 microversion: 2.1 time: 0.133003 Oct 12 12:41:53.089196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 264/554] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:52 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1461 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:53.102212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-118609c8-4796-425e-b479-ccff14b84099 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.106990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-118609c8-4796-425e-b479-ccff14b84099 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1219 microversion: 2.1 time: 0.088929 Oct 12 12:41:53.109992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 291/555] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:53 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:53.668726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:53.669099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:53.675188 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:53.675735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:53.676238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:53.677014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:53.677533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:53.678047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:53.820642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.830006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.831448 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:53.832599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6215568d-fc67-482c-889c-4c184693c86a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.168410 Oct 12 12:41:53.833143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 265/556] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:53 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:54.035161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:54.035772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:54.041954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.042575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.043029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.043716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.044160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.045103 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.079059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.079546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.080012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.080454 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'fault' on Instance uuid e3a51ad5-ef04-4f25-961e-6705be7abc42 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:54.113293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:54.113979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:54.120898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.121377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.121480 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:54.121805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.122527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.123609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.124027 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.130344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3481cdf7-d558-402e-8f6a-102271814ba3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 200 len: 1331 microversion: 2.1 time: 0.099194 Oct 12 12:41:54.131008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 292/557] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:54 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:54.135811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:54.137099 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:54.143061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.143514 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.144097 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.144942 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.145668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.146575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.161587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.162132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.162563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.162998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lazy-loading 'fault' on Instance uuid 08abde20-e25f-4e3f-8644-4ddbdf09bef6 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:54.211313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c96f2271cf394de1a15fcdfe3d62860a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '827d3a5990a940049bcb35a219efdef3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:54.218587 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:54.221892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c4cd7c37-8f61-4e94-b3b3-da36b14ef730 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1223 microversion: 2.1 time: 0.089694 Oct 12 12:41:54.222544 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 293/558] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:54 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:54.227245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-490a01da-3916-4cac-8c7c-08fe20158854 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 200 len: 1303 microversion: 2.1 time: 0.117739 Oct 12 12:41:54.227812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 266/559] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:54 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:54.863189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:54.863807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:54.869740 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.870511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.870952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:54.871643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:54.872094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:54.872519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.009481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:55.018799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:55.020254 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:55.021449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bee20b26-f5d9-42c7-ae14-655f4c426a59 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1808 microversion: 2.20 time: 0.162243 Oct 12 12:41:55.022263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 294/560] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:54 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:55.154888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:55.155632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:55.162537 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.163024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.163452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.164338 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.164833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.165402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.182648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 HTTP/1.1 Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:41:55.184283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:41:55.185978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'e3a51ad5-ef04-4f25-961e-6705be7abc42'} Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:41:55.186854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:41:55.188829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.190064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:41:55.190064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-118cf160-bed2-42cc-bab0-15fcc63d9bfb tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 404 len: 111 microversion: 2.1 time: 0.035342 Oct 12 12:41:55.190064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 267/561] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:55 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:41:55.194798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e0a5b67f-b3a3-4617-be62-883eed738b87 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '.version_select at 0x7f98053b6040>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:55.245827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:55.246495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:55.253244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.253925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.254454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.255150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.255610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.256019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.295510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e0a5b67f-b3a3-4617-be62-883eed738b87 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081483436" status: 202 len: 0 microversion: 2.1 time: 0.103822 Oct 12 12:41:55.299731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 295/562] 10.222.0.44 () {58 vars in 1221 bytes} [Wed Oct 12 12:41:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2081483436 => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:41:55.308077 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:55.308981 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] [instance: 08abde20-e25f-4e3f-8644-4ddbdf09bef6] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:55.317232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.318561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.319176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.320069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:55.320702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:55.321316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:55.329835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:55.337921 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-445aba64-4bb8-437e-bc85-b60149d41539 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1271 microversion: 2.1 time: 0.096235 Oct 12 12:41:55.338889 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 268/563] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:55 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1271 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:55.348303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] HTTP exception thrown: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Request method failure captured: Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 HTTP/1.1 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrW508AGTxNvYIv_iEoTbM5fBSPBO6KRQH4cQD0KRQ3uK5G_hGahmrnJNKfu4B_n-rhfpG8cfIM6wAKNOCwkXDBkJFUK6fBbzDaJkyJhl6BB1_hw3XxVATjyPOxb3hKlqayQSDZtne4wocLH_6xKm_BmX85JAz57WdKokkR9ac4AvYg Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 827d3a5990a940049bcb35a219efdef3 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:41:55.350927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/827d3a5990a940049bcb35a219efdef3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_827d3a5990a940049bcb35a219efdef3", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 827d3a5990a940049bcb35a219efdef3 Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-VolumesActionsTest-1721169646 Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-VolumesActionsTest-1721169646-project Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: c96f2271cf394de1a15fcdfe3d62860a Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-VolumesActionsTest-1721169646-project Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. Oct 12 12:41:55.352447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '08abde20-e25f-4e3f-8644-4ddbdf09bef6'} Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:41:55.353324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. Oct 12 12:41:55.354713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:41:55.356484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] Returning 404 to user: Instance 08abde20-e25f-4e3f-8644-4ddbdf09bef6 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:41:55.358039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7d1cb9ed-1f00-4b87-9870-51ac7b4b4038 tempest-VolumesActionsTest-1721169646 tempest-VolumesActionsTest-1721169646-project] 10.222.0.44 "GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6" status: 404 len: 111 microversion: 2.1 time: 0.055880 Oct 12 12:41:55.358608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 296/564] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:55 2022] GET /compute/v2.1/servers/08abde20-e25f-4e3f-8644-4ddbdf09bef6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:41:56.047253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:56.047871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:56.053984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.054474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.054910 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.055605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.056061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.056548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.199185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:56.199772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:56.205850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:56.217886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:56.221954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.223556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:56.225709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.225709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.225709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.225709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.226218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.235305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0e19bdca-aeda-4e17-86c0-dba8bd3d896a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1795 microversion: 2.20 time: 0.192006 Oct 12 12:41:56.236088 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 269/565] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:41:56 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1795 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:41:56.366157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:56.366157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:56.374741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'services' on Instance uuid 283eb4f3-2765-48cc-9bee-2178c185deca {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:41:56.375722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.376258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.376704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.377429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.378020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.379448 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.466972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:56.477210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fdfe305c-5875-4a6c-9c82-3d4a3e4da369 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1289 microversion: 2.1 time: 0.120206 Oct 12 12:41:56.490465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 270/566] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:56 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1289 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:41:56.625458 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:56.704893 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3ff14879-0c9e-4f99-bced-9a4afa572cd2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments/83d85b3a-9052-4dd5-8a57-1c99664d6957" status: 202 len: 0 microversion: 2.1 time: 0.509548 Oct 12 12:41:56.710958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 297/567] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:41:56 2022] DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments/83d85b3a-9052-4dd5-8a57-1c99664d6957 => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:41:56.715031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:56.717963 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:56.724494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.724988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.725421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.727189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:56.727189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:56.727189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:56.763033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-006a44ea-4ee5-421f-b6be-6aebaf5ed425 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052373 Oct 12 12:41:56.763614 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 271/568] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:41:56 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:57.503235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:57.504023 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:57.506303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:57.511513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:57.511994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:57.512419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:57.513110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:57.514144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:57.514565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:57.644209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:57.651695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e06f14dd-0175-47a0-9bf4-3fded8f8654c tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.153824 Oct 12 12:41:57.652252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 298/569] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:57 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:57.775690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:57.777961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:57.784311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:57.784794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:57.785235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:57.785925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:57.786412 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:57.786833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:57.812298 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:41:57.816977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e5b08a63-4151-4103-8b56-8a789f049144 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045307 Oct 12 12:41:57.817532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 272/570] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:41:57 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:41:58.680030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:58.680644 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:58.687108 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:58.687586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:58.688021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:58.688705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:58.689157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:58.689576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:58.819371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:41:58.827797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-66d221a6-45f1-4f83-b89a-0986dd7c14c7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.151603 Oct 12 12:41:58.831548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 299/571] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:58 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:41:58.831676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:58.833367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:58.840552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:58.841101 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:58.841602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:58.842426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:58.842945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:58.843432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:58.873524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8a283183-8d45-4456-9bdb-3fda43e8d299 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046848 Oct 12 12:41:58.874097 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 273/572] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:41:58 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:41:59.852419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:59.853030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:59.860074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:59.860551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:59.860979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:59.861663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:59.862158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:59.862581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:59.885159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:41:59.887397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:41:59.894162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:59.894645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:59.895077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:59.895764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:41:59.896211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:41:59.896631 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:41:59.928317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-19458022-c8a8-478b-802f-f22ef65357ba tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047009 Oct 12 12:41:59.928897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 274/573] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:41:59 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:00.056074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:00.063772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c4d11beb-ef82-44c4-bacf-1db92a73b31f tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.215095 Oct 12 12:42:00.064539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 300/574] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:41:59 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:00.865167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ba9c4a78-397b-4dc8-9127-b06fb13da4b7", "tag": "f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:00.874992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:00.877974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:00.877974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:00.887570 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] Creating event network-changed:f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6 for instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 on hv-cinder-81268 Oct 12 12:42:00.893234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-df3a222e-66f3-4be3-aa3f-b2f6846c58bb req-461afc89-245f-4725-b24c-f6e627a68040 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031708 Oct 12 12:42:00.894250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 275/575] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:00.941460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:00.944124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:00.952007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:00.952589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:00.953096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:00.953871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:00.955055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:00.955055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:00.985575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ae5998db-e49c-4142-8616-3485f3e9868f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048810 Oct 12 12:42:00.986232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 301/576] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:42:00 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:01.091758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:01.091758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:01.096603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:01.097544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:01.098468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:01.099407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:01.100229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:01.100838 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:01.246251 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:01.255345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-525b5ee8-b2c8-468f-9563-c1fef6eb52c5 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.171763 Oct 12 12:42:01.256217 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 276/577] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:01 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:01.911823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:01.920749 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:01.933015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:01.934898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:01.934898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:01.935214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:01.936193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:01.937064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:01.978760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'flavor' on Instance uuid a110aeab-b90f-4b91-b387-099acbf5cb62 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:02.006771 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:02.010663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:02.018100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.018100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.018920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.019847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.020504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.021371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.094046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-963e5dc5-6ea6-4c62-bf90-16bf20411b64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098877 Oct 12 12:42:02.094818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 277/578] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:42:01 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:02.279093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:02.280663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:02.287333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.288049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.288861 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.289566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.290042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.290634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.408781 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b98084ef-2ea1-406a-9abe-0583659447b0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/action" status: 200 len: 32 microversion: 2.1 time: 0.508084 Oct 12 12:42:02.409560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 302/579] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:42:01 2022] POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/action => generated 32 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:42:02.421576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:02.424435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:02.444775 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.445692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.447697 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.448562 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:02.452825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:02.453822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:02.477748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:02.489998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1f81eca3-831a-430d-ac22-906e653ebc60 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.214671 Oct 12 12:42:02.491632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 278/580] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:02 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:02.636244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:02.646471 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5d8cc74b-c41f-4761-93fb-eccf333ba27e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.230881 Oct 12 12:42:02.649979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 303/581] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:02 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:03.106933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:03.110428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:03.112538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:03.113471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:03.118885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.122764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.122764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.122764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.122764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.123781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.159080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fa261de9-efa7-4f86-b2e4-26dcbaab4531 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056092 Oct 12 12:42:03.160285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 279/582] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:42:03 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:03.517012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:03.517554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:03.519990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:03.525583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.531831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.531831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.531831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.531831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.532177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.672695 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:03.673842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:03.682108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.683013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.683739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.684986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:03.685802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:03.686465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:03.884748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:03.894853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-47b14170-e648-4051-8a7d-a9ee91b72641 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.227556 Oct 12 12:42:03.902408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 280/583] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:03 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:03.991100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:04.002485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dcc073c6-a797-4a22-ab66-b23b4a7cd621 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.489399 Oct 12 12:42:04.018403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 304/584] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:03 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:04.195527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:04.207600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:04.216828 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.217379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.218034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.219493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.220099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.221812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.268205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ee4bf73a-1e60-4063-a975-c5307278f74c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.080423 Oct 12 12:42:04.268972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 281/585] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:42:04 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca/os-volume_attachments => generated 25 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 12:42:04.350885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:04.351398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:04.359059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.359564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.360004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.360736 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.361203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.361627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.391934 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:42:04.918830 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:04.920394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:04.926832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.927399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.927907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.928676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:04.929206 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:04.929699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:04.992714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2ab25b84-87cf-4c55-ad0f-3f653119a4c0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 204 len: 0 microversion: 2.1 time: 0.645312 Oct 12 12:42:04.993474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 305/586] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:42:04 2022] DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 0 bytes in 647 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:42:05.003164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:05.004738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:05.013623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:05.014933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:05.015584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:05.016314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:05.016890 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:05.017363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:05.104747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:05.114971 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5326ddf7-88bb-4e4f-b61b-baa991520ed8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.200030 Oct 12 12:42:05.115804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 282/587] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:04 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:05.120940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:05.121748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:05.128148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:05.128824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:05.129414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:05.131478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:05.132100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:05.132698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:05.195552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:05.206007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e309a417-6ad6-4651-85c2-63de742521cf tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1681 microversion: 2.1 time: 0.207783 Oct 12 12:42:05.207519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 306/588] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:04 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1681 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:05.289515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:05.301013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-68b01461-d54f-4373-9bbd-96060b17c60a tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.184019 Oct 12 12:42:05.301888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 283/589] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:05 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:06.136283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9c4a78-397b-4dc8-9127-b06fb13da4b7", "name": "network-vif-plugged", "status": "completed", "tag": "f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:06.139927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:06.140692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:06.144811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.145215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.145657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.151526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.152037 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.152513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.153243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.153896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.155067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.159642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] Creating event network-vif-plugged:f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6 for instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 on hv-cinder-81268 Oct 12 12:42:06.164905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-8815c633-85b7-4d86-9661-8deae3dcc902 req-702916e3-ff39-42e2-ada4-0986e3b4a612 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037220 Oct 12 12:42:06.165707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 307/590] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:06.235763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:06.237160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:06.255475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.256089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.256631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.258530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.261500 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.262130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.337556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:06.356132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ed57ac9e-41ce-43c9-b6f4-695e29ded220 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.220065 Oct 12 12:42:06.369745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 284/591] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:06 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:06.376554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:06.377348 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:06.384681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.385180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.385619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.386431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:06.386830 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:06.387253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:06.439451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:06.455655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c9b89745-a58e-4e27-b331-4afdfa3504f0 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1681 microversion: 2.1 time: 0.225694 Oct 12 12:42:06.458110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 308/592] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:06 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1681 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:06.551787 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:06.560504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-780b3169-1fb4-49fe-906b-aac59bd6d684 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.188845 Oct 12 12:42:06.561074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 285/593] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:06 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:07.381355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:07.382242 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:07.391037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.391533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.392210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.392929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.393394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.393818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.481833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:07.483027 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:07.492697 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.493228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.493748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.500027 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.501475 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.501955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.646516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:07.652492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:07.658603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3bf0a311-fd9b-4904-9f6a-58b71859f0f1 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.280722 Oct 12 12:42:07.659628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 309/594] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:07 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:07.664222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d804bfda-8712-4f85-8a91-149a945a0b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1681 microversion: 2.1 time: 0.186936 Oct 12 12:42:07.664846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 286/595] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:07 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1681 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:07.675225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:07.676201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:07.682880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.683374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.683817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.684528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:07.684983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:07.685446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:07.917658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:07.925400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-97566218-818d-4853-84f8-d9d1ce78df38 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.254012 Oct 12 12:42:07.926052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 310/596] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:07 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:08.538558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "283eb4f3-2765-48cc-9bee-2178c185deca", "name": "network-vif-deleted", "tag": "774032af-94ee-4d83-8d1a-09707f3d7c09"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:08.563185 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.563685 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.564146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.594317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] Creating event network-vif-deleted:774032af-94ee-4d83-8d1a-09707f3d7c09 for instance 283eb4f3-2765-48cc-9bee-2178c185deca on hv-cinder-81268 Oct 12 12:42:08.603232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-77da3952-c015-4319-9844-5278608e75ef req-6c230fb5-a1cd-4c4a-9ce3-b36d58eb454d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068112 Oct 12 12:42:08.604174 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 287/597] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:08.696070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:08.699316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:08.700499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:08.705822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:08.727926 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.728428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.730933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.733138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.735064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.736628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.738027 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.738519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.738966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.744121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.744121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.745957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.795449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:08.860993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:08.874414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2c3e17b7-1fed-405b-a6ee-c6ff1f0d76b5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1327 microversion: 2.1 time: 0.182843 Oct 12 12:42:08.876528 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 288/598] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:08 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1327 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:08.954210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:08.954972 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:08.962081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.962571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.966368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:08.967828 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:08.969471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:08.970109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:09.016757 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:09.028815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-451970f3-360a-4c29-80b4-23ce9aaadcd9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.341739 Oct 12 12:42:09.040347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 311/599] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:08 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:09.182718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:09.202147 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-64aa02cf-222f-472b-a43e-bba041c6261b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1319 microversion: 2.1 time: 0.252839 Oct 12 12:42:09.202943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 289/600] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:08 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1319 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:09.908739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:09.909525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:09.923783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:09.924674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:09.925711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:09.926698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:09.927163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:09.932160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.016183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.016712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.017188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.022831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'fault' on Instance uuid 283eb4f3-2765-48cc-9bee-2178c185deca {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:10.055264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:10.056610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:10.081115 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.081963 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.086675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.086675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.086675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.086675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.096293 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:10.106991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fbda4195-bd16-41ce-a8f4-2255bc271375 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 200 len: 1332 microversion: 2.1 time: 0.203557 Oct 12 12:42:10.110192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 312/601] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:09 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 1332 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:10.221512 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:10.222481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:10.229238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.229812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.230379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.231121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.231731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.233291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.284829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:10.289694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:10.294408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-945c39da-676f-4a85-98bb-e77ff7c3de2a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.243887 Oct 12 12:42:10.295355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 290/602] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:10 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:10.401197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:10.410196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3406a9cc-bcab-496d-ad5e-0b0301ccf100 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1507 microversion: 2.1 time: 0.192477 Oct 12 12:42:10.411135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 313/603] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:10 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1507 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:10.436949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "500c7d05-c88c-4da1-b706-c7bb096cfa5d", "device": "/dev/sdb"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:10.440400 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:10.447446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.447931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.448363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:10.449055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:10.449506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:10.449949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:11.135580 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:11.136194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:11.142581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:11.149341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:11.149341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:11.149341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:11.149341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:11.149715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:11.159084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca HTTP/1.1 Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:42:11.160821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:42:11.162208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '283eb4f3-2765-48cc-9bee-2178c185deca'} Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:42:11.163120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:42:11.164441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:11.165523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:42:11.165523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-48f682b3-80f3-460e-9520-4b08d3e6524e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 404 len: 111 microversion: 2.1 time: 0.030496 Oct 12 12:42:11.165523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 314/604] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:11 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:42:11.171653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-29279a91-ba7f-4995-9459-d5321a7714df tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '.version_select at 0x7f980543f700>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:11.237635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-29279a91-ba7f-4995-9459-d5321a7714df tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472153960" status: 202 len: 0 microversion: 2.1 time: 0.070219 Oct 12 12:42:11.238434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 315/605] 10.222.0.44 () {58 vars in 1221 bytes} [Wed Oct 12 12:42:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1472153960 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:42:11.299056 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a21a69c5-71cb-4404-b2ac-d635470ab742 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "POST /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.867274 Oct 12 12:42:11.300880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 291/606] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:42:10 2022] POST /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7/os-volume_attachments => generated 194 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:11.325018 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:11.325904 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:11.338630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:11.339777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:11.340364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:11.341550 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:11.342756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:11.343861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:11.523999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:11.538578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2c3925bf-d45c-4efb-b40d-a8f85176465c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.224441 Oct 12 12:42:11.539645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 316/607] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:11 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:12.264960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-57e53ae8-58a1-4df3-a577-4058c5ff78e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: .version_select at 0x7f9805388310>, body: {"keypair": {"name": "tempest-keypair-235609407", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLKq7pG9cTUjQ00ZPqcngl0IoyZioSpfnE6XKFeaH1M2N2Y0pZcWnTfmf2EpPdBbexPLiVyiEljZE4F8ojiWK6HxqRU8oT9ggIr+UvH4qRJqLnreBZ/1dqyO+qgop4j7Gw=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:12.283252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-57e53ae8-58a1-4df3-a577-4058c5ff78e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:42:12.289279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-57e53ae8-58a1-4df3-a577-4058c5ff78e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:42:12.387172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-57e53ae8-58a1-4df3-a577-4058c5ff78e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.126690 Oct 12 12:42:12.389015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 292/608] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:42:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:12.602075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:12.602075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:12.616209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:12.619532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:12.621589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:12.624542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:12.626061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:12.632934 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:12.868176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:12.882778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6346c801-b652-4e65-8ad4-b8378957bc63 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.319393 Oct 12 12:42:12.884642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 317/609] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:12 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:13.910326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:13.912107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:13.921061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:13.923312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:13.924121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:13.925462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:13.926842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:13.928046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:14.126872 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:14.138397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fba40ec2-1dfc-4d5b-aa85-b3ed47b852d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.232985 Oct 12 12:42:14.139835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 293/610] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:13 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:14.818339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1591577675", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f74858ca-46a0-493d-924e-694edecfac99"}], "security_groups": [{"name": "tempest-securitygroup--1413715949"}], "key_name": "tempest-keypair-235609407", "user_data": "}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:14.944803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] validate_networks() for [('f74858ca-46a0-493d-924e-694edecfac99', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:42:15.173497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:15.177265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:15.190113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:15.190745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:15.191411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:15.192315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:15.192963 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:15.193611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:15.366992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:15.376593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d692b479-5005-4658-a1c3-337bdf4f8b53 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.212638 Oct 12 12:42:15.377764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 294/611] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:15 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:15.425773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:42:15.426472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:42:15.426946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:42:15.427383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:42:15.427794 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:42:15.442218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:15.442710 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:15.443146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:15.443881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:15.447048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:15.447488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:15.467638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:42:15.471915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:42:15.483994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:42:15.486390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:42:15.593998 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ae9821bf-ef28-4a1f-bb6f-b01af07fad22 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.781323 Oct 12 12:42:15.594996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 318/612] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:42:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 784 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:42:15.606363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-29f6cb00-4cc6-4934-baea-3d64965c7296 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:15.613221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-29f6cb00-4cc6-4934-baea-3d64965c7296 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:15.682694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-29f6cb00-4cc6-4934-baea-3d64965c7296 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:15.704206 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-29f6cb00-4cc6-4934-baea-3d64965c7296 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1241 microversion: 2.1 time: 0.101738 Oct 12 12:42:15.704784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 295/613] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:15 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1241 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:16.405573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:16.407189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:16.416336 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:16.417335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:16.418090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:16.419042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:16.420220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:16.420848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:16.589574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:16.600250 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f0ca3932-acd7-4406-b8cf-08b3619183f2 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.198572 Oct 12 12:42:16.600825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 319/614] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:16 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:16.727035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:16.729889 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:16.737909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:16.739799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:16.740275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:16.740703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:16.742138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:16.754204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:16.759638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:16.841235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:16.850083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ebe25766-a30b-421f-97c5-a08d945b2fca tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1245 microversion: 2.1 time: 0.127144 Oct 12 12:42:16.851270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 296/615] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:16 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1245 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:17.627856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:17.632623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:17.640167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:17.641593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:17.643363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:17.644338 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:17.645021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:17.645513 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:17.807349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:17.818823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4b00c3a4-c2a0-4ae6-8e95-d203a0b9a7da tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.194143 Oct 12 12:42:17.830014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 320/616] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:17 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:17.873654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:17.874894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:17.882145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:17.883346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:17.883860 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:17.884810 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:17.885358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:17.886055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:17.955898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:17.964115 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4a7a4f6c-c1b0-4628-bd34-e55a8db4583b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1293 microversion: 2.1 time: 0.095088 Oct 12 12:42:17.964702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 297/617] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:17 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1293 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:18.845915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:18.846491 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:18.852743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:18.853218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:18.853646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:18.854363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:18.854808 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:18.855224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:18.986284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:18.995443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-48d6a458-7d02-48c0-ac1a-122916236961 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.153463 Oct 12 12:42:18.995845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:18.996305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 321/618] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:18 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:18.996399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:19.003293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:19.003769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:19.004201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:19.004885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:19.005371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:19.005816 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:19.067774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:19.075518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7a04f0e9-4adf-433b-9965-4fdb1484df37 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1301 microversion: 2.1 time: 0.083677 Oct 12 12:42:19.076109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 298/619] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:18 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1301 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:20.021546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:20.022932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:20.031132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:20.031626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:20.032061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:20.032870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:20.033258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:20.033624 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:20.100507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:20.102317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:20.111086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:20.112138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:20.112855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:20.114832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:20.115812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:20.116258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:20.268654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:20.276694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-57740e1f-66c4-4804-bbd5-95b76c521a0d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.180476 Oct 12 12:42:20.277623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 299/620] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:20 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:20.391620 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:20.400365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-590b4578-69c0-4be8-801a-6e769fe482c8 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.384346 Oct 12 12:42:20.400979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 322/621] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:20 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:21.182878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e830ef8-8de0-4618-a5f7-173036554be9", "tag": "dd3b557f-93f8-4894-8fc4-0aea94fec83f"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:21.192875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:21.193341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:21.193793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:21.204985 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] Creating event network-changed:dd3b557f-93f8-4894-8fc4-0aea94fec83f for instance 6e830ef8-8de0-4618-a5f7-173036554be9 on hv-cinder-81268 Oct 12 12:42:21.210234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-888fefdd-ceb1-455b-9adb-8b069c473428 req-80a48a0b-f06d-420e-a0b5-b4ef493b0f78 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030949 Oct 12 12:42:21.214184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 300/622] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:21.305431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:21.306094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:21.313204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:21.313682 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:21.314140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:21.314818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:21.315265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:21.315680 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:21.425786 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:21.426502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:21.432696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:21.433255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:21.433689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:21.434414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:21.434850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:21.435266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:21.443177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:21.450820 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7fed4cd5-977e-42c2-a9fb-dfbc0273269a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.149249 Oct 12 12:42:21.451413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 323/623] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:21 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:21.561239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:21.569329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c1c3f1bf-42e3-4183-99d4-0f82a1a82bc9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.147843 Oct 12 12:42:21.569912 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 301/624] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:21 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:22.472609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:22.473127 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:22.479572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:22.480059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:22.480470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:22.481140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:22.481582 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:22.482028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:22.592750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:22.593355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:22.599909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:22.602689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:22.602689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:22.602689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:22.602689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:22.603047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:22.615506 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:22.624146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8d0e74d4-4bdd-464d-8710-c0feb54fe877 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.155400 Oct 12 12:42:22.627663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 324/625] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:22 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:22.733565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:22.742204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2b210bbd-3017-4eb8-8561-f9cd4cbdceff tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.153278 Oct 12 12:42:22.742768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 302/626] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:22 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:23.647635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:23.648268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:23.654284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:23.654839 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:23.660608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:23.660608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:23.660608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:23.660608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:23.765843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:23.766945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:23.774487 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:23.775134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:23.775668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:23.776532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:23.777110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:23.777618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:23.861012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:23.868665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d8a4884d-0769-4b19-99f3-8f6c593cc947 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.225087 Oct 12 12:42:23.869235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 325/627] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:23 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:23.911526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:23.919970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ca4c5f8b-0a72-4ef7-80af-3853915c955d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.158009 Oct 12 12:42:23.920538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 303/628] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:23 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:24.892484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:24.893763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:24.902097 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:24.903317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:24.904635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:24.905602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:24.906246 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:24.906763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:24.944152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:24.945963 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:24.951886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:24.952385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:24.953089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:24.953846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:24.954528 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:24.969865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:25.075356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:25.080062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5934935a-13ed-44e8-83db-a0cc48485ec9 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.191386 Oct 12 12:42:25.080638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 326/629] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:24 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:25.125255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:25.133488 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-439ed93f-8782-4703-957b-c52e38ccb721 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.193139 Oct 12 12:42:25.134093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 304/630] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:24 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:26.103350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:26.103955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:26.105784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:26.106459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:26.111642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:26.113563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:26.113563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:26.113563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:26.113825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:26.114221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:26.156610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:26.157250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:26.159242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:26.164428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:26.164911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:26.165346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:26.166066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:26.166518 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:26.166946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:26.250752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:26.255410 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-318810ff-535f-47ba-bcf9-1dba27fe8e8f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.155816 Oct 12 12:42:26.255982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 327/631] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:26 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:26.297391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:26.305374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-aafc8c98-1d2e-4ca5-b40c-20bdc96caf21 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.152749 Oct 12 12:42:26.305926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 305/632] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:26 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:27.277629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:27.278268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:27.285096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:27.285573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:27.286025 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:27.286704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:27.287150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:27.287622 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:27.328729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:27.329360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:27.335824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:27.336301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:27.336732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:27.337415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:27.337862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:27.338313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:27.415104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:27.423616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fddac4e5-65e4-4d4e-9e34-32548fcbf42e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.150091 Oct 12 12:42:27.424265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 328/633] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:27 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:27.466533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:27.475073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1745148f-dc16-4349-8d2f-f139d72b7f25 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.150194 Oct 12 12:42:27.475636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 306/634] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:27 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:28.446532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:28.450761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:28.450761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=83,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:28.455436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:28.455917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:28.456346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:28.457037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:28.457494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:28.457913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:28.499233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:28.500476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:28.507252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:28.507918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:28.508349 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:28.509075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:28.509516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:28.509952 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:28.603085 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:28.611304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0599f5ea-75af-4c1a-94a5-5db3ddcd3312 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.169857 Oct 12 12:42:28.611952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 329/635] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:28 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:28.644001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:28.652915 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c1564bef-e88d-43cf-8cc8-cdd2abdab8cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.157730 Oct 12 12:42:28.653490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 307/636] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:28 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:29.635259 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:29.635875 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:29.643076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:29.643568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:29.643999 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:29.644692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:29.645145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:29.645615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:29.649483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:29.675538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:29.676228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:29.682747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:29.683303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:29.683802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:29.684577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:29.685105 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:29.685523 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:29.777268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:29.785185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-208f4626-d6d4-41bb-8644-f2b8fd29d980 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.154079 Oct 12 12:42:29.785801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 330/637] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:29 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:29.820822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:29.824215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:29.829789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fdc80391-a835-4679-bd64-b534622405d7 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.158071 Oct 12 12:42:29.834104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 308/638] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:29 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:30.061845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e830ef8-8de0-4618-a5f7-173036554be9", "name": "network-vif-plugged", "status": "completed", "tag": "dd3b557f-93f8-4894-8fc4-0aea94fec83f"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:30.072626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:30.073115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:30.073547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:30.086629 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] Creating event network-vif-plugged:dd3b557f-93f8-4894-8fc4-0aea94fec83f for instance 6e830ef8-8de0-4618-a5f7-173036554be9 on hv-cinder-81268 Oct 12 12:42:30.091585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-bc3cac52-2d70-45dd-8ae5-d024733afa38 req-fca00944-5412-4d64-a13c-971cde6fb2cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 Oct 12 12:42:30.092167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 331/639] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:30.808546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:30.809146 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:30.816302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:30.816784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:30.817210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:30.817889 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:30.818362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:30.825438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:30.853905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:30.854664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:30.861115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:30.861531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:30.861991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:30.862683 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:30.863176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:30.865645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:30.952588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:30.960706 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6cfb637b-6971-4c06-97f6-30933465cb24 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.156801 Oct 12 12:42:30.961271 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 309/640] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:30 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:31.003209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:31.011669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ce3094d1-9a53-4373-8623-5fdddeea9a8a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1737 microversion: 2.1 time: 0.162557 Oct 12 12:42:31.012238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 332/641] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:30 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:31.984845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:31.985559 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:31.992453 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:31.992928 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:31.993356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:31.994064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:31.994545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:31.994989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.038183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:32.038870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:32.045301 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.045792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.046311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.047625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.048090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.048516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.128995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:32.136882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ea8216b8-fe15-40ad-8585-d00ba0a6479d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.156725 Oct 12 12:42:32.137536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 310/642] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:31 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:32.179117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:32.187249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-43500b9f-93b6-4c03-a9fc-a285dc519be9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1717 microversion: 2.1 time: 0.152917 Oct 12 12:42:32.187815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 333/643] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:32 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1717 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:32.295625 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:32.296119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:32.302203 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.302690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.303121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.303803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.304256 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.304680 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.384169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] HTTP exception thrown: Cannot 'detach_volume' instance a110aeab-b90f-4b91-b387-099acbf5cb62 while it is in vm_state rescued Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Request method failure captured: Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments/9edf1037-676b-452d-9a0a-e7576faed1d6 HTTP/1.1 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrU1VxMPMBEYG6xK_zUp8DE1DjUPcBFE3OVhqKM2683QHF89iGkf8UjWvsnL3mjJzwaoSeXII1nOJ7zmeSEN5FXHuSO0_2YLMuhub4pGMpS3om3FZx39RYQuEsjDTIvOuEkwjYXmEvYOzsDX9qaZ1QF_uijpp2iGTmCm1s7kbI47Shc Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:42:32.385769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d62398af777d4d269977b1a5f1f37080", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 19d863a45ac14c50b940fbc217b70929 Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:42:32.387330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Cannot 'detach_volume' instance a110aeab-b90f-4b91-b387-099acbf5cb62 while it is in vm_state rescued Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'server_id': 'a110aeab-b90f-4b91-b387-099acbf5cb62', 'id': '9edf1037-676b-452d-9a0a-e7576faed1d6'} Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 in vm_state rescued. Cannot detach_volume while the instance is in this state. Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:42:32.388131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a110aeab-b90f-4b91-b387-099acbf5cb62 while it is in vm_state rescued Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a110aeab-b90f-4b91-b387-099acbf5cb62 while it is in vm_state rescued Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:42:32.389681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Returning 409 to user: Cannot 'detach_volume' instance a110aeab-b90f-4b91-b387-099acbf5cb62 while it is in vm_state rescued {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:42:32.391491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-39d90081-9c02-4f0c-8ad7-348bf1e96b89 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments/9edf1037-676b-452d-9a0a-e7576faed1d6" status: 409 len: 152 microversion: 2.1 time: 0.095540 Oct 12 12:42:32.391491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 311/644] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:42:32 2022] DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments/9edf1037-676b-452d-9a0a-e7576faed1d6 => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Oct 12 12:42:32.396813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:32.405260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:32.405260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.405260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.405260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.405668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.405668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.405668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.610614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-71ff0161-aeee-4cc1-9fbd-a2eb6ededcae tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/action" status: 202 len: 0 microversion: 2.1 time: 0.213191 Oct 12 12:42:32.610614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 334/645] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:42:32 2022] POST /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:42:32.615099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:32.615705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:32.622309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.622786 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.623212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.623930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.624529 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.624670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:32.625489 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.625735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:32.632094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.632587 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.633050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.633742 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:32.634253 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:32.634679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:32.715654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lazy-loading 'services' on Instance uuid ba9c4a78-397b-4dc8-9127-b06fb13da4b7 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:32.758482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:32.767352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8afdb348-3ab9-462e-a862-dcf0d8cff9c9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1725 microversion: 2.1 time: 0.156024 Oct 12 12:42:32.767914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 312/646] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:32 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:32.932840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-122bd3b1-786d-4aed-b11e-e2753c30c0fe tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7/os-volume_attachments/500c7d05-c88c-4da1-b706-c7bb096cfa5d" status: 202 len: 0 microversion: 2.1 time: 0.312520 Oct 12 12:42:32.933429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 335/647] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:42:32 2022] DELETE /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7/os-volume_attachments/500c7d05-c88c-4da1-b706-c7bb096cfa5d => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:42:33.159971 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:33.160574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:33.167052 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:33.167543 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:33.167953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:33.168626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:33.169075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:33.169492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:33.303056 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:33.310755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-09b0897c-59c6-4cd2-a8c7-854953d36f77 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1367 microversion: 2.1 time: 0.154605 Oct 12 12:42:33.311330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 313/648] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:33 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:33.791270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:33.791955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:33.798150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:33.798630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:33.799057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:33.799730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:33.800175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:33.800588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:33.930441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:33.938833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-30f4475c-99f2-44e0-b63f-0b57788ffb85 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1725 microversion: 2.1 time: 0.152251 Oct 12 12:42:33.941109 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 336/649] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:33 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:34.334087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:34.334632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:34.341031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.341503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.341946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:34.342628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.343076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.343512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:34.467552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:34.475149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2061530c-4070-4607-99c3-ad0358efaa21 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1558 microversion: 2.1 time: 0.145038 Oct 12 12:42:34.475743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 314/650] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:34 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1558 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:34.497811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:34.498331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:34.504653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.505130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.505560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:34.506278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.506725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.507144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:34.585431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c866b0f8-f6af-4f0c-9647-8b05d77fdb91 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.091614 Oct 12 12:42:34.585996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 337/651] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:42:34 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:34.963592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:34.964200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:34.970750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.971490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.971925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:34.973048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:34.973661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:34.974270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:35.414668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:35.422944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fc4793f2-9ca6-4ca6-b12d-f5af17446a2e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1725 microversion: 2.1 time: 0.463319 Oct 12 12:42:35.423504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 315/652] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:34 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1725 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:35.799289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e830ef8-8de0-4618-a5f7-173036554be9", "tag": "dd3b557f-93f8-4894-8fc4-0aea94fec83f"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:35.808840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:35.809322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:35.809753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:35.822990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] Creating event network-changed:dd3b557f-93f8-4894-8fc4-0aea94fec83f for instance 6e830ef8-8de0-4618-a5f7-173036554be9 on hv-cinder-81268 Oct 12 12:42:35.827837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-0628ee8d-b5e2-427b-b6d3-ba2cde94eae1 req-cb18b428-746e-4364-aaee-8ce39e047945 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032743 Oct 12 12:42:35.828992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 338/653] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:36.178143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:36.178677 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:36.184781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.185289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.185726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.186447 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.186903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.187947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.212656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:42:36.447271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:36.447959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:36.454178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.454657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.455083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.455762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.456208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.456797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.495541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4f1fbf8f-f71c-446f-acdc-a916ec26a6cd tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 204 len: 0 microversion: 2.1 time: 0.321094 Oct 12 12:42:36.496524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 316/654] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:42:36 2022] DELETE /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:42:36.505240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:36.506191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:36.512659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.513157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.513594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.514343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:36.514799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:36.515331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:36.608292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:36.618339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-be208cfa-ee59-48e8-bc6b-6e5e86d5d42a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1725 microversion: 2.1 time: 0.175433 Oct 12 12:42:36.619228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 339/655] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:36 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1725 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:36.672416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:36.683822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b235e57a-b2ae-4f90-80f3-105c7605a709 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1559 microversion: 2.1 time: 0.182674 Oct 12 12:42:36.690449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 317/656] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:36 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:37.642600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:37.643203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:37.649583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.650100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.650536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.651219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.651671 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.652094 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.707333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:37.707964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:37.714399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.714874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.715300 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.715984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.716428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.716853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.779546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:37.788280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f3cbfdfa-ba53-4791-9fa6-2fcef70f394c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1731 microversion: 2.1 time: 0.149462 Oct 12 12:42:37.788948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 340/657] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:37 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1731 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:37.811234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:37.811722 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:37.817598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.818140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.818556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.819243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:37.819694 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:37.820112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:37.845585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:37.853439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a45bce2f-1918-4179-966e-6e801f91c4ed tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1513 microversion: 2.1 time: 0.150044 Oct 12 12:42:37.854028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 318/658] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:37 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:37.894354 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-34d5d3d9-cb80-4d72-8fdf-a0b69affa776 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.086751 Oct 12 12:42:37.894899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 341/659] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:42:37 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-interface => generated 285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:38.876990 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:38.877590 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:38.883965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:38.884442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:38.884874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:38.885562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:38.886030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:38.886450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:39.018857 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:39.038433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b9620dfd-7621-4c73-a71c-bfb2ab187202 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1513 microversion: 2.1 time: 0.165199 Oct 12 12:42:39.054188 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 319/660] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:38 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1513 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:39.054980 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:39.067308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:39.068133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:39.068793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:39.081507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] Creating event network-changed:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:42:39.088088 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-4fdb9d46-b40a-49ae-83a6-d4c3cb78f160 req-d525ee9d-ead2-4fc3-a6d1-55d74b72610a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038186 Oct 12 12:42:39.088800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 342/661] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:40.064304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:40.065691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:40.080670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:40.084484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:40.085000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:40.086103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:40.086608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:40.087505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:40.140209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ba9c4a78-397b-4dc8-9127-b06fb13da4b7", "name": "network-vif-deleted", "tag": "f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:40.150808 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:40.152573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:40.152573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:40.163633 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] Creating event network-vif-deleted:f872a7e4-aff7-4ecb-b2b1-e6e9191db1f6 for instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 on hv-cinder-81268 Oct 12 12:42:40.166953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:40.168626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-0c4d6f49-7326-4957-8f3a-e70d2d8cd126 req-d8355920-aad7-400d-9d62-80bf261f93cd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032973 Oct 12 12:42:40.169399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 343/662] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:42:40.175904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d170aeef-2895-4aee-954f-0ca1e34d89e7 tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1471 microversion: 2.1 time: 0.115505 Oct 12 12:42:40.176464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 320/663] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:40 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1471 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:41.102861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:41.112176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:41.112643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:41.113064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:41.124204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] Creating event network-changed:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:42:41.129581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-e95dda60-3333-4bba-a7be-cb582bfa6f88 req-8057e4d7-e280-4244-a3e6-8a691cb6e211 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030644 Oct 12 12:42:41.130213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 344/664] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:41.199374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:41.200285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:41.207075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:41.207788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:41.208214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:41.208914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:41.209365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:41.210053 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:41.241706 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:41.242220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:41.242650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:41.243096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lazy-loading 'fault' on Instance uuid ba9c4a78-397b-4dc8-9127-b06fb13da4b7 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:41.288335 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '07dec04c01264b90aa962053c6d1304a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0c9f0d8dfa9544a9a9fec1c5dad43d74', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:41.299948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ebb1ba0e-cb23-4197-aed8-f2a17387533e tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 200 len: 1309 microversion: 2.1 time: 0.104365 Oct 12 12:42:41.310125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 321/665] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:41 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 1309 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:42:42.324921 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:42.325595 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] [instance: ba9c4a78-397b-4dc8-9127-b06fb13da4b7] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:42.332385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:42.332884 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:42.333324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:42.334046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:42.334511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:42.334940 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:42.348193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] HTTP exception thrown: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Request method failure captured: Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 HTTP/1.1 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrWoYIxSxzWc-TgnDT1nYzsemX6nePioh1QhaPsvXTarog_pW6Zwl5CZOKZep7Q_rNPPFb2Liqyjncq1z2vKqu9gkuJg-Jv-VbhT8u99G8oYtQmRzZiS3ey1OPMHkYvhwOHvcodUkCv4hXX48611npbH64v2LQr0k5a0nlKBUZ7Am3s Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 0c9f0d8dfa9544a9a9fec1c5dad43d74 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:42:42.349806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/0c9f0d8dfa9544a9a9fec1c5dad43d74"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_0c9f0d8dfa9544a9a9fec1c5dad43d74", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 0c9f0d8dfa9544a9a9fec1c5dad43d74 Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1571967228 Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-VolumesSnapshotTestJSON-1571967228-project Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 07dec04c01264b90aa962053c6d1304a Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-VolumesSnapshotTestJSON-1571967228-project Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. Oct 12 12:42:42.351397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'ba9c4a78-397b-4dc8-9127-b06fb13da4b7'} Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:42:42.352276 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. Oct 12 12:42:42.353673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:42.355087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] Returning 404 to user: Instance ba9c4a78-397b-4dc8-9127-b06fb13da4b7 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:42:42.355087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0425d2b6-745b-4702-81bd-29c196caf92b tempest-VolumesSnapshotTestJSON-1571967228 tempest-VolumesSnapshotTestJSON-1571967228-project] 10.222.0.44 "GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7" status: 404 len: 111 microversion: 2.1 time: 0.031074 Oct 12 12:42:42.355087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 345/666] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:42:42 2022] GET /compute/v2.1/servers/ba9c4a78-397b-4dc8-9127-b06fb13da4b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:42:47.287197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:47.287747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:47.297309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.297309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.297309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.297309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.298260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.298260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.325652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3acbbfde-3ebe-46ea-af5f-88be9a3d3bce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments/f42dc8f1-c111-4692-bfe3-b7eaa1a3b61b" status: 200 len: 194 microversion: 2.20 time: 0.042423 Oct 12 12:42:47.326383 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 322/667] 10.222.0.44 () {60 vars in 1454 bytes} [Wed Oct 12 12:42:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments/f42dc8f1-c111-4692-bfe3-b7eaa1a3b61b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:42:47.397581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:47.398102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:47.404623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.405102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.405536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.406252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.406744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.407280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.487630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'services' on Instance uuid 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:47.693843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d6417210-6347-4801-9e08-6357dcf0ff11 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments/f42dc8f1-c111-4692-bfe3-b7eaa1a3b61b" status: 202 len: 0 microversion: 2.20 time: 0.299887 Oct 12 12:42:47.694555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 346/668] 10.222.0.44 () {60 vars in 1457 bytes} [Wed Oct 12 12:42:47 2022] DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments/f42dc8f1-c111-4692-bfe3-b7eaa1a3b61b => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:42:47.703107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:47.705430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:47.711406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.711892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.712322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.713011 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:47.713460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:47.713879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:47.730948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:47.744705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-31dee18c-2aa7-451c-b113-9757db827283 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045665 Oct 12 12:42:47.745257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 323/669] 10.222.0.44 () {60 vars in 1343 bytes} [Wed Oct 12 12:42:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:42:48.758914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:48.761232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:48.767859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:48.768345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:48.768784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:48.769479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:48.769954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:48.770385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:48.801912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a9c1b0da-5344-494c-990c-24d6054806ff tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047348 Oct 12 12:42:48.804453 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 347/670] 10.222.0.44 () {60 vars in 1343 bytes} [Wed Oct 12 12:42:48 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:42:49.815529 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:49.817858 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:49.820555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:49.825799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:49.826329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:49.826812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:49.827500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:49.827948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:49.828383 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:49.857685 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4d48023c-4ca6-4773-8351-77fafdd0685b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046692 Oct 12 12:42:49.858426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 324/671] 10.222.0.44 () {60 vars in 1343 bytes} [Wed Oct 12 12:42:49 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:42:49.922382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:49.922877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:49.929296 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:49.929782 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:49.930260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:49.930946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:49.931404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:49.931826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:49.957770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:42:49.972197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:42:50.254848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5a69ba53-5fb4-4b18-be98-5ddcb3303ac6 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 204 len: 0 microversion: 2.20 time: 0.336072 Oct 12 12:42:50.255471 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 348/672] 10.222.0.44 () {60 vars in 1280 bytes} [Wed Oct 12 12:42:49 2022] DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 12:42:50.264044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:50.267285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:50.271617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:50.272096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:50.272524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:50.273291 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:50.273741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:50.274201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:50.409575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:50.417705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:50.419257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:50.420674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-72a6843a-bafc-4759-a4ce-ad3c6e8a8f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.160683 Oct 12 12:42:50.421050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 325/673] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:50 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:42:51.447061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:51.448318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:51.454679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:51.455731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:51.456164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:51.456854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:51.457350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:51.457756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:51.586927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:51.595206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:51.596598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:51.597754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1dae9908-99ad-42ae-a0f5-306552f2d878 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.155028 Oct 12 12:42:51.598344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 349/674] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:51 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:42:52.623558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:52.624232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:52.630732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:52.631211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:52.631638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:52.632325 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:52.632772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:52.633255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:52.762989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:52.771741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:52.773249 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:52.774431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8341d638-cd2b-4a1f-a8c3-ed9a02e32130 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1723 microversion: 2.20 time: 0.155170 Oct 12 12:42:52.775020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 326/675] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:52 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:42:53.068389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2", "name": "network-vif-deleted", "tag": "5987ac83-3534-44f8-b03e-d740853eca66"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:53.077720 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:53.078465 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:53.084284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:53.091735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] Creating event network-vif-deleted:5987ac83-3534-44f8-b03e-d740853eca66 for instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 on hv-cinder-81268 Oct 12 12:42:53.097343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-fc71f525-f21e-46f3-a21f-8699a124f79e req-883924b5-077d-4a92-994e-f11bcee59ea3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033550 Oct 12 12:42:53.097979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 350/676] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:42:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:42:53.800003 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:53.800608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:53.807057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:53.807536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:53.807967 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:53.808651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:53.809406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:53.809686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:53.841890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:53.842493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:53.842946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:53.843388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'fault' on Instance uuid 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:53.884154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:53.893185 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:53.894685 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:53.895869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9dc13368-a137-44e5-874b-614ced8ba064 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1370 microversion: 2.20 time: 0.100425 Oct 12 12:42:53.896432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 327/677] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:53 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1370 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:42:54.922478 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:54.923096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:54.929666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:54.930170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:54.930600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:54.931274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:54.931715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:54.932128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:54.962211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:54.962672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:54.963096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:54.963529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'fault' on Instance uuid 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:55.006583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:55.014592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:55.018885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:55.018885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3624fe7c-65f0-402d-9f0c-3cb93bcf7fce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1370 microversion: 2.20 time: 0.099662 Oct 12 12:42:55.018885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 351/678] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:54 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:42:56.042392 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:56.043028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:56.048855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:56.049331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:56.049759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:56.050460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:56.050904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:56.051328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:56.082622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:56.083114 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:56.083535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:56.083975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'fault' on Instance uuid 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:42:56.126585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:56.135060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:56.136502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:42:56.137638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b435e39f-9190-490a-a489-db00f6cb572f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 200 len: 1370 microversion: 2.20 time: 0.099402 Oct 12 12:42:56.138222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 328/679] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:56 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 1370 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:42:57.163126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:57.163738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:42:57.170134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:57.170617 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:57.171053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:57.171741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:42:57.172196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:42:57.172625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:42:57.185613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 HTTP/1.1 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:42:57.187268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:42:57.188973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2'} Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:42:57.189905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:42:57.191228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:42:57.192344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:42:57.192344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a0f1f599-a8e2-42d5-8310-31c95a7c70f1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 404 len: 111 microversion: 2.20 time: 0.030027 Oct 12 12:42:57.192344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 352/680] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:42:57 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:42:57.197397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4884e81c-4dec-44bd-974a-cb111722c0b2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '.version_select at 0x7f980527d940>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:42:57.277772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4884e81c-4dec-44bd-974a-cb111722c0b2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-155442488" status: 204 len: 0 microversion: 2.20 time: 0.084126 Oct 12 12:42:57.278359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 329/681] 10.222.0.44 () {60 vars in 1259 bytes} [Wed Oct 12 12:42:57 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-155442488 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 12:42:58.012067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-18ce9ccb-f599-40ec-af68-78ca6e7fc82b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: .version_select at 0x7f98053515e0>, body: {"keypair": {"name": "tempest-keypair-1078181031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVkT/Nu8sMK8Szr0ztmiz65S1lbYEAviR6Nl7DRkyimElsxts2h5sQspb3ZXnFecdDa/uZCd7yjH5pBsv7ED0FV7N2VIyyD2+OSGZLmO8cc5RjNRFL8OKjlaqiiYXm15g=="}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:42:58.027454 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-18ce9ccb-f599-40ec-af68-78ca6e7fc82b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for project c056ad05ef9843688f08b7e9f25e1138. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:42:58.031605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-18ce9ccb-f599-40ec-af68-78ca6e7fc82b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for user df8da1fe608d4dd6acb6b7298ca56d45 and project c056ad05ef9843688f08b7e9f25e1138. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:42:58.107630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-18ce9ccb-f599-40ec-af68-78ca6e7fc82b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.099424 Oct 12 12:42:58.108230 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 353/682] 10.222.0.44 () {62 vars in 1200 bytes} [Wed Oct 12 12:42:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 101 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Oct 12 12:43:00.401650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1626862737", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a509b816-30d9-40f4-99f7-35e308d0dd5d"}], "security_groups": [{"name": "tempest-securitygroup--1320748030"}], "key_name": "tempest-keypair-1078181031", "user_data": "}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:00.501218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] validate_networks() for [('a509b816-30d9-40f4-99f7-35e308d0dd5d', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:43:00.861578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:43:00.862057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:43:00.862557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:43:00.862968 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:43:00.863380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:43:00.872438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:00.872918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:00.873349 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:00.874118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:00.874569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:00.874991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:00.892285 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for project c056ad05ef9843688f08b7e9f25e1138. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:43:00.896851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Getting quotas for user df8da1fe608d4dd6acb6b7298ca56d45 and project c056ad05ef9843688f08b7e9f25e1138. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:43:00.907542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:43:00.909793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:43:01.011527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a255ce12-9ad0-4045-ae83-a44bedb0999a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.615472 Oct 12 12:43:01.012233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 330/683] 10.222.0.44 () {62 vars in 1188 bytes} [Wed Oct 12 12:43:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Oct 12 12:43:01.024032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:01.024733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:01.026704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:01.084798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:01.092852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:01.094330 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:01.095425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9f011eaf-e63f-46c7-a513-ded2197ef9a4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1282 microversion: 2.20 time: 0.076095 Oct 12 12:43:01.095971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 354/684] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:01 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:02.120591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:02.121306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:02.128194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:02.128671 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:02.129136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:02.129819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:02.130827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:02.131250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:02.356553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:02.364825 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:02.366359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:02.367579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cf9e7d84-20bc-476c-97d5-07e9550e04e3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1278 microversion: 2.20 time: 0.250982 Oct 12 12:43:02.368124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 331/685] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:02 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1278 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:03.392845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:03.393451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:03.400297 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:03.400829 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:03.401221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:03.401913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:03.402389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:03.402815 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:03.547763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:03.556661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:03.558227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:03.559430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c34cd58b-1bec-4afb-8d8e-a154e07db579 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1352 microversion: 2.20 time: 0.170683 Oct 12 12:43:03.560062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 355/686] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:03 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1352 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:04.585416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:04.586060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:04.592563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:04.593044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:04.593470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:04.594188 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:04.594634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:04.595049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:04.727824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:04.735994 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:04.739438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:04.739438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4064b295-9d90-4cd6-9076-a02cee016981 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.157821 Oct 12 12:43:04.739438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 332/687] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:04 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:04.860756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:04.871392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:04.872169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:04.878347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:04.885117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] Creating event network-changed:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:43:04.890146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-12e17287-a49a-4819-9908-ad48aafd91d2 req-b6495141-b023-4a0a-8448-ec15a412d76b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033889 Oct 12 12:43:04.890755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 356/688] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:05.765374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:05.766000 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:05.772849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:05.773458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:05.773896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:05.774608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:05.775054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:05.775470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:05.904025 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:05.912125 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:05.913665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:05.914878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-880f50b9-c78d-45b8-b00b-1f5b41a552ce tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.153446 Oct 12 12:43:05.915444 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 333/689] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:05 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:06.940670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:06.941367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:06.947541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:06.948020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:06.948456 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:06.951226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:06.951226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:06.951226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:07.077158 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:07.085612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:07.087085 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:07.088185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3e6b3236-ab99-4a54-9c60-958857ebd26e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.152260 Oct 12 12:43:07.088746 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 357/690] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:06 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:08.112557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:08.113156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:08.119669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:08.120153 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:08.120628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:08.121373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:08.122128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:08.122548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:08.253506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:08.262189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:08.263634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:08.264743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f1d4ce58-30fd-485a-b78c-8e2ce74946dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.156041 Oct 12 12:43:08.265519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 334/691] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:08 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:09.290046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:09.290650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:09.297089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:09.297570 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:09.298036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:09.298725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:09.299177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:09.299598 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:09.428928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:09.436985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:09.439905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:09.439905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-55f402c8-07c4-4a05-af62-c0b96eee3b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.154225 Oct 12 12:43:09.446207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 358/692] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:09 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:10.465783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:10.466422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:10.472924 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:10.473399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:10.473834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:10.474585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:10.475023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:10.478439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:10.605157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:10.613954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:10.615632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:10.616699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "name": "network-vif-plugged", "status": "completed", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:10.617988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1be91d55-401a-41d0-8e4d-d2988f03555e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.156062 Oct 12 12:43:10.619268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 335/693] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:10 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:10.640402 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:10.641887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:10.642677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:10.655168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] Creating event network-vif-plugged:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:43:10.660231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-29ae10c5-4aea-4c72-9ac9-ef458995842b req-4d8560e5-d5d1-4a00-a8d0-f51fedd844d9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048828 Oct 12 12:43:10.660973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 359/694] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:43:11.647575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:11.648181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:11.650626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:11.651280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:11.656636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:11.659736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:11.659736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:11.659736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:11.659736 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:11.660075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:11.792154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:11.800097 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:11.801642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:11.802781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0a0b64a5-0565-4b14-a911-7a73da907f26 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1408 microversion: 2.20 time: 0.159188 Oct 12 12:43:11.803335 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 336/695] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:11 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:12.824595 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:12.988966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:12.989663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:12.995789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:12.996267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:12.996695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:12.997622 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:12.998130 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:12.998545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:13.128120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:13.136550 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:13.138000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:13.139133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2f83fe40-aa4d-4437-a2b6-d83ac68c1e70 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1600 microversion: 2.20 time: 0.315484 Oct 12 12:43:13.139684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 360/696] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:12 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1600 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:13.163599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:13.164092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:13.170768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:13.171423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:13.171852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:13.172541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:13.172992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:13.173410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:13.248641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-63f36eed-d4b4-460c-836d-c717b7c88bfb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.088900 Oct 12 12:43:13.249238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 337/697] 10.222.0.44 () {60 vars in 1316 bytes} [Wed Oct 12 12:43:13 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:43:14.427951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:14.437726 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:14.438305 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:14.438801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:14.449385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] Creating event network-changed:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:43:14.454268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-25dfb74f-ee35-485a-b3a1-53dff2b94d19 req-9f71d4fc-1eb4-4d66-a666-f05168cce4de service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029982 Oct 12 12:43:14.454941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 361/698] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:17.066044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:17.066621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:17.072851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:17.073402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:17.073832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:17.074545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:17.075023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:17.075442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:17.153491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'services' on Instance uuid a110aeab-b90f-4b91-b387-099acbf5cb62 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:17.328578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ac1949e6-127f-412e-82b7-410ac8beb140 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments/9edf1037-676b-452d-9a0a-e7576faed1d6" status: 202 len: 0 microversion: 2.1 time: 0.267123 Oct 12 12:43:17.329158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 338/699] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:43:17 2022] DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments/9edf1037-676b-452d-9a0a-e7576faed1d6 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:43:17.338517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:17.340810 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:17.346935 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:17.347412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:17.347842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:17.348520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:17.348969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:17.349386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:17.379319 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7b69a344-4677-4781-ba56-b3becd72543e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045587 Oct 12 12:43:17.379868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 362/700] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:17 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:18.393423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:18.395705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:18.402550 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:18.403027 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:18.403456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:18.404163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:18.404607 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:18.405023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:18.433411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2d038fc2-4ea1-4758-ae76-a633f40fa9d0 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Oct 12 12:43:18.433974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 339/701] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:18 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:19.444660 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:19.446862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:19.453181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:19.453665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:19.454133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:19.454822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:19.455271 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:19.455696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:19.486090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:19.490791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-97749fda-535f-4573-a847-8e53acd43567 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050081 Oct 12 12:43:19.491355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 340/702] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:19 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:43:19.498696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:19.499183 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:19.505228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:19.505737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:19.506211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:19.506900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:19.507346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:19.507765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:19.532899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-eee143f2-fb02-4d47-b566-c9478c574ac3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/ips" status: 200 len: 151 microversion: 2.1 time: 0.137026 Oct 12 12:43:19.533440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 363/703] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:43:19 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/ips => generated 151 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:20.503826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:20.505986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:20.508628 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:20.513900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:20.514409 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:20.514842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:20.515531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:20.515984 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:20.516403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:20.546714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-742cba2f-6c36-4202-9b80-351d40dc4e38 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046890 Oct 12 12:43:20.547275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 341/704] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:20 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:21.115666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c75f6158-7eb2-49d9-b239-5912213107af"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:21.118039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:21.124721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.125207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.125643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.126360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.126879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.127347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.131083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=65,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:21.559334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:21.561527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:21.568974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.569451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.569884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.570592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.571039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.571456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.600723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-aa7eb6e9-40bd-4012-8019-4483b4e8dedd tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045811 Oct 12 12:43:21.608567 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 342/705] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:21 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Oct 12 12:43:21.685033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:21.685534 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:21.691875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.692359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.692797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.693490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.693952 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.694399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.719444 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:43:21.796437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-18c91b77-2950-4b14-b42a-bb77075edada tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.684521 Oct 12 12:43:21.797096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 364/706] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:43:21 2022] POST /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments => generated 194 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:21.981126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9f476202-2012-444a-bdd5-2facb9409b1e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 204 len: 0 microversion: 2.1 time: 0.300224 Oct 12 12:43:21.981635 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 343/707] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:43:21 2022] DELETE /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:43:21.990698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:21.991397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:21.998384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:21.998865 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:21.999297 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:21.999982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:22.000441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:22.000949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:22.129396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:22.137604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-651bc90e-11d2-47d6-8aaa-98dc11219542 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.151569 Oct 12 12:43:22.140509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 365/708] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:21 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:23.162309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:23.162937 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:23.169425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:23.169925 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:23.170374 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:23.171049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:23.171494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:23.171909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:23.298200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:23.305711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-51d217d1-90ec-4b46-8ff2-cdb187af4b47 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.147786 Oct 12 12:43:23.306301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 344/709] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:23 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:24.329046 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:24.329657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:24.336104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:24.336588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:24.337021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:24.337707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:24.338193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:24.338672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:24.470155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:24.477886 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4c8b1bed-646f-4d22-8c39-faec959c7277 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.153166 Oct 12 12:43:24.478476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 366/710] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:24 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:43:25.500767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:25.501579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:25.508137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:25.508622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:25.509054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:25.509747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:25.510262 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:25.510745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:25.642732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:25.651211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-46e3dff6-d7a4-4848-b557-dbdc11ebbcca tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.154388 Oct 12 12:43:25.651580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 345/711] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:25 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:26.674615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:26.675168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:26.681476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:26.682017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:26.682452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:26.683135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:26.683586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:26.684007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:26.808602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:26.816295 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-19448ded-31f7-4203-8638-236136c4eb34 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.145638 Oct 12 12:43:26.816865 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 367/712] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:26 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:27.839479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:27.840091 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:27.846608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:27.847116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:27.847553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:27.848246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:27.848702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:27.849131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:27.977043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:27.985468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b73f1166-f198-468c-9339-f11065b89adb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1691 microversion: 2.1 time: 0.149931 Oct 12 12:43:27.986057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 346/713] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:27 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1691 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:28.873785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a110aeab-b90f-4b91-b387-099acbf5cb62", "name": "network-vif-deleted", "tag": "62e7a189-3e2c-4b4b-b6b8-a25215b993be"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:28.884166 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:28.884747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:28.885177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:28.896864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] Creating event network-vif-deleted:62e7a189-3e2c-4b4b-b6b8-a25215b993be for instance a110aeab-b90f-4b91-b387-099acbf5cb62 on hv-cinder-81268 Oct 12 12:43:28.901776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-a77a3817-aa6c-4594-a16d-065fdcfa4137 req-2f9177de-f819-4dbf-9268-45c1d003b57b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032306 Oct 12 12:43:28.902442 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 368/714] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:29.009259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:29.010701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:29.022345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:29.023250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:29.024332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:29.025197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:29.025815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:29.026422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:29.105207 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:29.114890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fb8e0082-5ee4-4a2f-b697-08ae657b8127 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 200 len: 1331 microversion: 2.1 time: 0.109426 Oct 12 12:43:29.115550 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 347/715] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:29 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 1331 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:30.139268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:30.140121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: a110aeab-b90f-4b91-b387-099acbf5cb62] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:30.146588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:30.147070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:30.147504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:30.148195 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:30.148664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:30.149080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:30.162357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] HTTP exception thrown: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Request method failure captured: Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 HTTP/1.1 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrU1VxMPMBEYG6xK_zUp8DE1DjUPcBFE3OVhqKM2683QHF89iGkf8UjWvsnL3mjJzwaoSeXII1nOJ7zmeSEN5FXHuSO0_2YLMuhub4pGMpS3om3FZx39RYQuEsjDTIvOuEkwjYXmEvYOzsDX9qaZ1QF_uijpp2iGTmCm1s7kbI47Shc Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:43:30.172505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d62398af777d4d269977b1a5f1f37080", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 19d863a45ac14c50b940fbc217b70929 Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. Oct 12 12:43:30.174079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'a110aeab-b90f-4b91-b387-099acbf5cb62'} Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:43:30.174996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. Oct 12 12:43:30.176485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:30.177843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Returning 404 to user: Instance a110aeab-b90f-4b91-b387-099acbf5cb62 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:43:30.177843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-72e83dd4-5197-4989-8cda-163e883899db tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62" status: 404 len: 111 microversion: 2.1 time: 0.031010 Oct 12 12:43:30.177843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 369/716] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:30 2022] GET /compute/v2.1/servers/a110aeab-b90f-4b91-b387-099acbf5cb62 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:43:30.178106 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4ccc99d4-eaf8-4b9d-9cd7-07b2a71dc16f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '.version_select at 0x7f98053099d0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:30.251411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4ccc99d4-eaf8-4b9d-9cd7-07b2a71dc16f tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744795171" status: 202 len: 0 microversion: 2.1 time: 0.080586 Oct 12 12:43:30.251982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 348/717] 10.222.0.44 () {58 vars in 1221 bytes} [Wed Oct 12 12:43:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1744795171 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:43:33.537511 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:33.540615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:33.540760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=34 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:33.545359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:33.545842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:33.546316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:33.547038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:33.547493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:33.547923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:33.575586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:43:33.878575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e890bf0e-dc97-46e1-9e6c-9e88ffac5a3a tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 204 len: 0 microversion: 2.1 time: 0.344627 Oct 12 12:43:33.879275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 370/718] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:43:33 2022] DELETE /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:43:33.888314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:33.888934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:33.897442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:33.897954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:33.898379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:33.899248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:33.899703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:33.900129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:34.033045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:34.041328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5310c9c2-9a32-4ecd-a39b-b5d035481cee tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1508 microversion: 2.1 time: 0.157745 Oct 12 12:43:34.042642 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 349/719] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:33 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:35.065867 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:35.067153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:35.074356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:35.077040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:35.077040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:35.077040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:35.077040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:35.077479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:35.335551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:35.343631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-05836a9b-c110-4fa5-b3fc-f4aad4e3560d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1508 microversion: 2.1 time: 0.282555 Oct 12 12:43:35.349957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 371/720] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:35 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1508 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:36.368610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:36.370643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:36.378424 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.379238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.380035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:36.380845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.381423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.381977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:36.541230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:36.549319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-432bfd51-e962-4c67-b3dc-68ea740845cb tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1508 microversion: 2.1 time: 0.186238 Oct 12 12:43:36.563208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 350/721] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:36 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1508 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:36.780055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c75f6158-7eb2-49d9-b239-5912213107af"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:36.783186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:36.791329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.792369 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.792865 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:36.793575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.794243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.794871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:36.882220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: POST /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments HTTP/1.1 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 74 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:43:36.884252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {"volumeAttachment": {"volumeId": "c75f6158-7eb2-49d9-b239-5912213107af"}} Oct 12 12:43:36.887275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'server_id': '6e830ef8-8de0-4618-a5f7-173036554be9', 'body': {'volumeAttachment': {'volumeId': 'c75f6158-7eb2-49d9-b239-5912213107af'}}} Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:36.888181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:36.889601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 400 to user: Invalid volume: volume c75f6158-7eb2-49d9-b239-5912213107af is already attached to instances: 6e830ef8-8de0-4618-a5f7-173036554be9 {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6ef1b88b-38b3-4907-b26a-d2662b47ceaa tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.110533 Oct 12 12:43:36.891140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 372/722] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:43:36 2022] POST /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments => generated 174 bytes in 115 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:43:36.956075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:36.956573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:36.962465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.962953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.963403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:36.964074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:36.964521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:36.965135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.052821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'services' on Instance uuid 6e830ef8-8de0-4618-a5f7-173036554be9 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:37.301343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-938e6eb6-8f10-49bd-8b96-69cfb0fcbfb1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments/c75f6158-7eb2-49d9-b239-5912213107af" status: 202 len: 0 microversion: 2.1 time: 0.348968 Oct 12 12:43:37.302226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 351/723] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:43:36 2022] DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments/c75f6158-7eb2-49d9-b239-5912213107af => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:43:37.311317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:37.313487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:37.319551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:37.320038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:37.320499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.321201 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:37.321760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:37.322379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.353003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-59c85d31-dc05-4a61-85d1-83796e5d78d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046030 Oct 12 12:43:37.353567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 373/724] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:37 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:37.575284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:37.576121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:37.583925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:37.585388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:37.586196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.587141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:37.587810 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:37.588392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.683739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:37.691906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cfa950cc-ff79-4e24-90b5-88cba1147192 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1466 microversion: 2.1 time: 0.121199 Oct 12 12:43:37.692990 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 374/725] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:37 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1466 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:37.700905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "11e5f782-870a-40d7-a8ff-1a10204d7a88", "name": "network-vif-deleted", "tag": "c71a3103-728d-4917-bb33-d259926bb1a1"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:37.717368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:37.718323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:37.718757 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:37.731473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] Creating event network-vif-deleted:c71a3103-728d-4917-bb33-d259926bb1a1 for instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 on hv-cinder-81268 Oct 12 12:43:37.737246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-742ab763-de09-4a1d-8c8c-fd1948e55e4c req-39279513-b6cb-41fd-8d13-00f1570f729d service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217326 Oct 12 12:43:37.737926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 352/726] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:38.373343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:38.376599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:38.390316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:38.390806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:38.391244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:38.391976 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:38.392429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:38.392852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:38.440814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2284953a-0405-4ffd-ba2e-95a63247277c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073674 Oct 12 12:43:38.441882 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 375/727] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:38 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:38.722699 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:38.724098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:38.732961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:38.733746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:38.734432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:38.735335 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:38.737016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:38.737659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:38.785714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:38.786323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:38.786814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:38.787323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'fault' on Instance uuid 11e5f782-870a-40d7-a8ff-1a10204d7a88 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:38.843329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:38.853647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5007eb40-70b4-4986-9c4f-1c20e9d80ca4 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 200 len: 1311 microversion: 2.1 time: 0.139346 Oct 12 12:43:38.854410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 353/728] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:38 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 1311 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:39.454597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:39.456974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:39.463610 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.464091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.464525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.465303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.465758 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.466205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.501799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-58b49144-d281-4242-92de-457eab4e34e3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049810 Oct 12 12:43:39.501799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 376/729] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:43:39 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:43:39.567950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:39.570754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:39.575468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.575959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.576591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.577297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.578080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.578511 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.604688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:43:39.735421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:39.877215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:39.877856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 11e5f782-870a-40d7-a8ff-1a10204d7a88] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:39.883801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.884288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.895739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.895739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.895739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.895739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.899333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] HTTP exception thrown: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Request method failure captured: Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 HTTP/1.1 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrU1VxMPMBEYG6xK_zUp8DE1DjUPcBFE3OVhqKM2683QHF89iGkf8UjWvsnL3mjJzwaoSeXII1nOJ7zmeSEN5FXHuSO0_2YLMuhub4pGMpS3om3FZx39RYQuEsjDTIvOuEkwjYXmEvYOzsDX9qaZ1QF_uijpp2iGTmCm1s7kbI47Shc Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:43:39.900855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d62398af777d4d269977b1a5f1f37080", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 19d863a45ac14c50b940fbc217b70929 Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. Oct 12 12:43:39.902602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '11e5f782-870a-40d7-a8ff-1a10204d7a88'} Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:43:39.903416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. Oct 12 12:43:39.905280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:39.906919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Returning 404 to user: Instance 11e5f782-870a-40d7-a8ff-1a10204d7a88 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:43:39.906919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-55a723a2-93d0-4cf3-be40-88c1ba12b4b3 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88" status: 404 len: 111 microversion: 2.1 time: 0.029057 Oct 12 12:43:39.906919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 377/730] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:39 2022] GET /compute/v2.1/servers/11e5f782-870a-40d7-a8ff-1a10204d7a88 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:43:39.911041 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:39.911526 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:39.917181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.917657 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.918139 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.918874 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.919328 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.919745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.945745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:43:39.947408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6a2bdbe5-e86d-4a19-a55e-ad9c84eecb14 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 204 len: 0 microversion: 2.1 time: 0.383857 Oct 12 12:43:39.947922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 354/731] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:43:39 2022] DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 12:43:39.956545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:39.957234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:39.963169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.963651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.964072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.964933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:39.965533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:39.966133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:39.983831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:40.120046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:40.128140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-543c42c2-308c-4f23-8931-16341df95412 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1683 microversion: 2.1 time: 0.175643 Oct 12 12:43:40.128708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 355/732] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:39 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1683 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:40.279007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b6d1659b-a35e-4c4d-9e60-503a3aaab56c tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "DELETE /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 204 len: 0 microversion: 2.1 time: 0.371288 Oct 12 12:43:40.280321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 378/733] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:43:39 2022] DELETE /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Oct 12 12:43:40.289441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:40.290076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:40.296137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:40.296632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:40.297071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:40.297767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:40.298247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:40.299573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:40.506268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:40.521897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5b120f58-0f6d-4320-a285-9b97041c288e tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.237055 Oct 12 12:43:40.522785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 356/734] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:40 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:41.152609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:41.153494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:41.164774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:41.165393 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:41.165852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:41.166621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:41.167079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:41.167554 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:41.320898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:41.328736 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bf97172f-2715-4f1a-9e50-5499e8b4b229 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1683 microversion: 2.1 time: 0.180842 Oct 12 12:43:41.329301 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 379/735] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:41 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1683 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:41.546959 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:41.548100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:41.555266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:41.555759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:41.557536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:41.557536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:41.557896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:41.558357 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:41.766168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:41.783542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-eec11b04-6908-47bf-9ed9-4e2ba8acee95 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.242503 Oct 12 12:43:41.785227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 357/736] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:41 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:42.352662 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:42.353281 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:42.364557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:42.365336 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:42.367193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:42.368128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:42.368764 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:42.369355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:42.545768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:42.554545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c74ef10d-e2d6-4bb4-8863-650b08e4ba29 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1683 microversion: 2.1 time: 0.205748 Oct 12 12:43:42.555232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 380/737] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:42 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1683 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:42.812888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:42.813527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:42.823626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:42.824881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:42.825676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:42.826751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:42.827819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:42.828485 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:43.040263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:43.048875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-55dc302b-d6b1-424a-8af6-f91eb3b2fac9 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.240815 Oct 12 12:43:43.049452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 358/738] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:42 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:43.579708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:43.580332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:43.589325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:43.589811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:43.590269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:43.590970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:43.591421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:43.602225 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:43.744043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:43.753396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c54a6509-fd4c-4c63-bafc-e616bdaf912a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1683 microversion: 2.1 time: 0.178180 Oct 12 12:43:43.753987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 381/739] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:43 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1683 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:44.076430 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:44.077697 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:44.085331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:44.086079 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:44.086687 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:44.087755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:44.088365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:44.088956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:44.281508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:44.289156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b06a234b-bf98-4c8f-bc9e-7c20d6405225 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.220312 Oct 12 12:43:44.293843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 359/740] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:44 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:44.780602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:44.781279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:44.791967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:44.792580 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:44.796952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:44.796952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:44.796952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:44.796952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:45.054248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:45.063417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ea5d9c9b-a12b-41c7-aa0e-606b2ee7bb5b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1683 microversion: 2.1 time: 0.290021 Oct 12 12:43:45.064347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 382/741] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:44 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1683 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:43:45.314583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:45.316180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:45.325983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:45.328316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:45.328991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:45.330214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:45.331230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:45.331892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:45.723192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:45.733372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d1e09a34-b557-4e65-a3b5-847b2d503d61 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1522 microversion: 2.1 time: 0.422788 Oct 12 12:43:45.734110 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 360/742] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:45 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1522 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:45.827853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e830ef8-8de0-4618-a5f7-173036554be9", "name": "network-vif-deleted", "tag": "dd3b557f-93f8-4894-8fc4-0aea94fec83f"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:45.843991 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:45.844876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:45.845485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:45.863670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] Creating event network-vif-deleted:dd3b557f-93f8-4894-8fc4-0aea94fec83f for instance 6e830ef8-8de0-4618-a5f7-173036554be9 on hv-cinder-81268 Oct 12 12:43:45.874065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-16ba0a6d-9356-494f-82d6-bc4b3a09e40b req-a3818850-dfb7-480b-bf67-acbee05469d0 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048912 Oct 12 12:43:45.875021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 383/743] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:46.089283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:46.090004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:46.097142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.097627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.098084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.098776 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.099526 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.100011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.224164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:46.251337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ae46f5b3-3b99-4fb0-beaa-b566d9f61008 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 200 len: 1326 microversion: 2.1 time: 0.167016 Oct 12 12:43:46.252533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 384/744] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:46 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 1326 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:43:46.416804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9a56b7b4-f127-4adf-bf73-a699108a7a11", "name": "network-vif-deleted", "tag": "72e52c23-5517-41fd-8ed1-dd798c7bba3a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:46.433581 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.434235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.434761 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.464203 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] Creating event network-vif-deleted:72e52c23-5517-41fd-8ed1-dd798c7bba3a for instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 on hv-cinder-81268 Oct 12 12:43:46.470439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-177bbb48-3855-4590-883c-757aff1d9988 req-46d635f8-1d6f-4dba-ac73-b4bdb125a2fa service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.485379 Oct 12 12:43:46.472218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 361/745] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:46.608678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e9bafb97-d05a-4de6-8aa3-8ec8708a3068 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Action: 'create', calling method: .version_select at 0x7f98053c88b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1979552841", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHjad7eQTaNNyyT2RinNriEBLaGMO2M7NyfzkWGSK8t8LdFcp61ofPtypC9Fl7CWVXviRyciqi73j4+s5Tep/+XdyVSYCfnZnhQHhSPTZECbOzLJZFQkcDIM6s2zQ4xoTw=="}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:46.624846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-e9bafb97-d05a-4de6-8aa3-8ec8708a3068 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:43:46.628850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-e9bafb97-d05a-4de6-8aa3-8ec8708a3068 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for user 205b19ccb80a45fd8ed36abd2c4c32c3 and project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:43:46.721518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e9bafb97-d05a-4de6-8aa3-8ec8708a3068 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.237124 Oct 12 12:43:46.722466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 385/746] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:43:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:46.762016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:46.763055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:46.771583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.772343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.772943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.775569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.786078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.787040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.840995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:46.842685 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:46.843293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:46.843885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lazy-loading 'fault' on Instance uuid 9a56b7b4-f127-4adf-bf73-a699108a7a11 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:46.916461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19d863a45ac14c50b940fbc217b70929', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd62398af777d4d269977b1a5f1f37080', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:46.945054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d1debc1b-d257-4574-ae8f-5cca73c9f644 tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 200 len: 1312 microversion: 2.1 time: 0.177477 Oct 12 12:43:46.945054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 362/747] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:46 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 1312 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:47.282075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:47.282075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:47.286187 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:47.286907 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:47.287403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:47.288207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:47.288718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:47.289206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:47.303510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 HTTP/1.1 Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:43:47.305477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:43:47.306858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '6e830ef8-8de0-4618-a5f7-173036554be9'} Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:43:47.307692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:43:47.308915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.316001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:43:47.316001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-987e1931-74dd-4ba2-a612-3952e05d150f tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 404 len: 111 microversion: 2.1 time: 0.034105 Oct 12 12:43:47.316001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 386/748] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:47 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:43:47.317762 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a8879166-05c8-4afb-ae9b-918c824d5938 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '.version_select at 0x7f980527dca0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:47.401150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a8879166-05c8-4afb-ae9b-918c824d5938 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-235609407" status: 202 len: 0 microversion: 2.1 time: 0.088414 Oct 12 12:43:47.402138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 363/749] 10.222.0.44 () {58 vars in 1218 bytes} [Wed Oct 12 12:43:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-235609407 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:43:47.961090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:47.962105 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] [instance: 9a56b7b4-f127-4adf-bf73-a699108a7a11] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:47.969418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:47.970448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:47.971224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:47.972347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:47.973020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:47.973658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:47.993073 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] HTTP exception thrown: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Request method failure captured: Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 HTTP/1.1 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrU1VxMPMBEYG6xK_zUp8DE1DjUPcBFE3OVhqKM2683QHF89iGkf8UjWvsnL3mjJzwaoSeXII1nOJ7zmeSEN5FXHuSO0_2YLMuhub4pGMpS3om3FZx39RYQuEsjDTIvOuEkwjYXmEvYOzsDX9qaZ1QF_uijpp2iGTmCm1s7kbI47Shc Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:43:47.995262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/d62398af777d4d269977b1a5f1f37080"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_d62398af777d4d269977b1a5f1f37080", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: d62398af777d4d269977b1a5f1f37080 Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1987801466 Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 19d863a45ac14c50b940fbc217b70929 Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1987801466-project Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. Oct 12 12:43:47.999013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '9a56b7b4-f127-4adf-bf73-a699108a7a11'} Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:43:47.999878 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. Oct 12 12:43:48.001277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:43:48.002594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] Returning 404 to user: Instance 9a56b7b4-f127-4adf-bf73-a699108a7a11 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:43:48.002594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dc7c524b-9153-4096-b09d-f7d64103c90d tempest-ServerRescueNegativeTestJSON-1987801466 tempest-ServerRescueNegativeTestJSON-1987801466-project] 10.222.0.44 "GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11" status: 404 len: 111 microversion: 2.1 time: 0.040534 Oct 12 12:43:48.002594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 387/750] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:47 2022] GET /compute/v2.1/servers/9a56b7b4-f127-4adf-bf73-a699108a7a11 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:43:48.339874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-517114ef-a38c-4bba-8269-7d1c93dd5fc7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: .version_select at 0x7f980523f670>, body: {"keypair": {"name": "tempest-keypair-1304304595", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImc7kBrMm5LfzdGokDvgRhCdgyM3V9XDJw1IEBxr3sxyyh/cDavx7BPYC0N3GGz0IfrVN3lr3GVxUKtAnQSm/X2I4HWpclQKhWNqQrEcH8RMuoCI5J1uJfoJCv3wfRDfQ=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:48.384446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-517114ef-a38c-4bba-8269-7d1c93dd5fc7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:43:48.391151 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-517114ef-a38c-4bba-8269-7d1c93dd5fc7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:43:48.528072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-517114ef-a38c-4bba-8269-7d1c93dd5fc7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.201163 Oct 12 12:43:48.535799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 364/751] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:43:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:50.439588 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:50.440067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:50.448077 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:50.449199 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:50.449806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:50.450855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:50.451515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:50.452102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:50.507066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8922a807-42ee-4384-9f9b-ad333b830ba1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/ips" status: 200 len: 152 microversion: 2.20 time: 0.070844 Oct 12 12:43:50.507982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 388/752] 10.222.0.44 () {60 vars in 1289 bytes} [Wed Oct 12 12:43:50 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/ips => generated 152 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Oct 12 12:43:51.776840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-535823662", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f74858ca-46a0-493d-924e-694edecfac99"}], "security_groups": [{"name": "tempest-securitygroup--750798008"}], "key_name": "tempest-keypair-1304304595", "user_data": "}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:51.785247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:51.887674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] validate_networks() for [('f74858ca-46a0-493d-924e-694edecfac99', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:43:52.101035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:52.101575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:52.109399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.110223 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.111025 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.111969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.112582 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.113162 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.139581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lazy-loading 'flavor' on Instance uuid 6222337e-587d-4200-bcb3-264fc5b2395d {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:52.443870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-04693ae8-17a5-4243-8800-9a42527d7075 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "POST /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d/action" status: 202 len: 0 microversion: 2.1 time: 0.346791 Oct 12 12:43:52.444772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 389/753] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:43:52 2022] POST /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d/action => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:43:52.454049 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:52.454757 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:52.462422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.463353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.464072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.464795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.465248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.465665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.505235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:43:52.505662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:43:52.506166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:43:52.506573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:43:52.506974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:43:52.516512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.517020 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.517501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.518259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:52.518710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:52.519128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:52.544804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:43:52.549040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Getting quotas for user 39543aedd1834f68a9d0a4ef174822c2 and project fb8207ad9abf449b99382a2586d4588a. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:43:52.562343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:43:52.564712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:43:52.635934 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:52.645074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-23a2ed41-6d7c-4384-8cde-f10e240a3bf3 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.195964 Oct 12 12:43:52.646402 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 390/754] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:52 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:43:52.720405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1042ab84-d82b-4ee9-ace9-1ea07972b5d3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.948192 Oct 12 12:43:52.722344 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 365/755] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:43:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 951 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:43:52.735575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-422ab727-b45d-4300-95c7-49e429f784f5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:52.736534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-422ab727-b45d-4300-95c7-49e429f784f5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:52.848630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-422ab727-b45d-4300-95c7-49e429f784f5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:52.866132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-422ab727-b45d-4300-95c7-49e429f784f5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1241 microversion: 2.1 time: 0.134752 Oct 12 12:43:52.867717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 391/756] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:52 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1241 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:53.105461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:53.106559 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:53.117362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.118104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.118985 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.125678 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.125678 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.125678 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.157738 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'flavor' on Instance uuid e5aa1837-38c8-4935-9019-b77ddab6186b {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:43:53.672652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:53.673850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:53.679224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9897af9b-27e7-4ab3-a9e2-f639d92ef26b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/action" status: 202 len: 0 microversion: 2.20 time: 0.580686 Oct 12 12:43:53.683572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 366/757] 10.222.0.44 () {62 vars in 1319 bytes} [Wed Oct 12 12:43:53 2022] POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/action => generated 0 bytes in 586 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:43:53.683874 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.684419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.686486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.688547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.690151 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.690333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:53.690965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:53.693823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.697656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.698422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.699121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.700319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:53.700973 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:53.701457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:53.874315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:53.883137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:53.884694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:53.885995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4c73baad-b0da-4472-b3dd-42b16a56a329 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.200615 Oct 12 12:43:53.886565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 367/758] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:53 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:43:53.906247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8989e088-0e1c-4d50-a444-f832c29e33f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:53.906853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8989e088-0e1c-4d50-a444-f832c29e33f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:53.962342 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8989e088-0e1c-4d50-a444-f832c29e33f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:53.970677 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8989e088-0e1c-4d50-a444-f832c29e33f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1241 microversion: 2.1 time: 0.075865 Oct 12 12:43:53.971263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 368/759] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:53 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:54.147630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:54.160328 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-17c16b99-6c34-4d90-aea3-2bea0143821b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.494808 Oct 12 12:43:54.161000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 392/760] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:53 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:54.912732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:54.913389 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:54.922368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:54.923226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:54.923941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:54.925104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:54.925873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:54.926702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:54.995948 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:54.996707 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:55.004362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:55.004850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:55.009801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:55.009801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:55.009801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:55.009801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:55.078487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:55.086207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-85a8500b-29d4-4b98-80f5-3cbc357915a6 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1293 microversion: 2.1 time: 0.093985 Oct 12 12:43:55.086771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 393/761] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:54 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1293 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:55.113140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:55.125189 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:55.126693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:55.127873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d1fbf8e4-4611-47cf-83d5-1c1545a5b243 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.219850 Oct 12 12:43:55.128437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 369/762] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:54 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:43:55.183770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:55.184392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:55.190984 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:55.191466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:55.191899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:55.192586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:55.193040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:55.193457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:55.330424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:55.339768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-07002b3d-d281-4dc5-947d-757926fe9727 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.159747 Oct 12 12:43:55.343662 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 394/763] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:55 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:56.110743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:56.111262 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:56.130832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.131553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.132157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.133042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.133906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.134535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.152648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:56.153371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:56.160808 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.161334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.162316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.163161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.163621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.164274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.250465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:56.260340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-50d33800-a14c-4dd2-8420-61b64eac8822 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1299 microversion: 2.1 time: 0.154500 Oct 12 12:43:56.273960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 370/764] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:56 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1299 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:56.351434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:56.361168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:56.363311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:56.363567 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:56.364179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:56.365214 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-43184896-bf6c-4cfd-8ddc-a43fff914b97 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.216384 Oct 12 12:43:56.366499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 395/765] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:56 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:43:56.380036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.380648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.381224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.382140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:56.382869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:56.383662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:56.680659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:56.686744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-bf752df2-58fb-4454-b1bc-f8e7644e2dcf tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.326809 Oct 12 12:43:56.687330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 371/766] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:56 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:43:57.287327 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:57.287966 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:57.296476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.297043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.297488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.298319 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.298772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.299197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.391755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:57.392382 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:57.399275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.399564 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.400024 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.400673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.401496 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.402177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.511962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:57.530255 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d72667f8-c82b-4978-a3b7-a09a25152d40 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.246019 Oct 12 12:43:57.538952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 396/767] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:57 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:57.611521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:57.620458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:57.621907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:57.623387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b8060e8e-41c7-4020-b6e6-615e094f7ac2 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.235310 Oct 12 12:43:57.624253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 372/768] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:57 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:43:57.716763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:57.720716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:57.727401 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.727896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.728486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.729406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.729862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.730314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.733754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:57.870557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29def05a-0aa9-48ba-8880-44b19b216766", "tag": "3af0b0da-4e0e-4354-b176-3e8eda704ca2"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:43:57.879568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:57.888650 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:57.890580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:57.891387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:57.895858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d0c969bb-b724-4d5f-9687-70fae87c431e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.184683 Oct 12 12:43:57.896728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 397/769] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:57 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:57.907614 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] Creating event network-changed:3af0b0da-4e0e-4354-b176-3e8eda704ca2 for instance 29def05a-0aa9-48ba-8880-44b19b216766 on hv-cinder-81268 Oct 12 12:43:57.913377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-897b0a9c-4384-43ae-8cca-0be7b0cd55ea req-62863bf9-cec7-4cb8-b327-f490d92204c2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056119 Oct 12 12:43:57.913377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 373/770] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:43:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:43:58.554856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:58.556066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:58.564343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.565061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.565739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:58.566637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.567278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.567871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:58.651274 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:58.652077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:58.663839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.664158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.664584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:58.666152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.666621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.667046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:58.675231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:43:58.796367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:58.805004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cb86079a-cc87-4323-a0f4-35147c9fa68a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.254519 Oct 12 12:43:58.805581 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 398/771] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:58 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:58.827444 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:58.835594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:58.837136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:58.838311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-285988d0-4734-4f50-bb13-7edcbe5de720 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.193400 Oct 12 12:43:58.838865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 374/772] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:58 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:43:58.922284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:58.922908 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:58.929308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.930074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.930668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:58.931549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:58.932899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:58.932899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:59.070318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:43:59.078360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-787f7fa9-eddd-4539-8305-4ccd5d6a9f32 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.160661 Oct 12 12:43:59.078925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 399/773] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:58 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:43:59.828669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:59.829276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:59.835791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:59.836265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:59.836724 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:59.837572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:59.838057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:59.838475 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:59.866013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:43:59.866013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:43:59.872607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:59.873919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:59.874459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:43:59.875503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:43:59.875964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:43:59.876392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:00.006572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:00.015596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-653904cc-b206-403d-9159-82820f573226 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.191528 Oct 12 12:44:00.016163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 375/774] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:43:59 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:00.042604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:00.053606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:00.055217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:00.056417 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ca58fa95-7000-491c-9d33-4404947a0d8b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.195461 Oct 12 12:44:00.056989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 400/775] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:43:59 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:00.102583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:00.103339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:00.109691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:00.110192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:00.110618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:00.111294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:00.111780 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:00.112192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:00.256763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:00.265653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-672de886-bfcc-4fd7-bf83-12947bcf5d5f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.166993 Oct 12 12:44:00.266260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 376/776] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:00 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:01.038231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:01.038849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:01.045748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.046267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.046702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.047390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.047844 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.048270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.082046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:01.082853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:01.089409 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.097468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.097468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.097468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.097468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.097851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.199359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:01.204721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9e865a94-33be-4dc9-a314-49d6f2bca1f3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.170389 Oct 12 12:44:01.205287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 401/777] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:01 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:01.267569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:01.279072 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:01.281290 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:01.282640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-df4e6755-67fa-4782-8c0d-b6e47bf4e351 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.204470 Oct 12 12:44:01.283197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 377/778] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:01 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:01.289602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:01.290247 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:01.299821 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.301100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.302290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.303569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:01.304126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:01.306070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:01.440372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:01.448037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b4651f1b-4ead-4b15-8c91-29a972084321 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.163154 Oct 12 12:44:01.448606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 402/779] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:01 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:02.227372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:02.227975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:02.234382 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.234852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.235276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.235983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.236429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.236849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.310653 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:02.311267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:02.318576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.319066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.319557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.320198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.320655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.321080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.368853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:02.377467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c374144d-8503-4f04-beaa-a84f377517d1 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.153931 Oct 12 12:44:02.378140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 378/780] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:02 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:02.448876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:02.456822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:02.458290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:02.459427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fda89309-a224-4403-b39c-eccec00dab1c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.152762 Oct 12 12:44:02.459979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 403/781] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:02 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:02.470964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:02.471612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:02.477655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.478181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.478623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.479314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:02.479774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:02.480196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:02.527779 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:02.607434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:02.615696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fdfcb9e9-b16e-455f-99d9-a3f46e93a8f4 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.148740 Oct 12 12:44:02.616265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 379/782] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:02 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:02.903039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:03.040666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29def05a-0aa9-48ba-8880-44b19b216766", "name": "network-vif-plugged", "status": "completed", "tag": "3af0b0da-4e0e-4354-b176-3e8eda704ca2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:03.050406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.050883 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.051311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.062131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] Creating event network-vif-plugged:3af0b0da-4e0e-4354-b176-3e8eda704ca2 for instance 29def05a-0aa9-48ba-8880-44b19b216766 on hv-cinder-81268 Oct 12 12:44:03.067527 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-ea042e80-2d41-4c3d-9275-fb03081aca74 req-56bdca78-48b9-42d8-b496-9f9d67162608 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.173308 Oct 12 12:44:03.068129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 404/783] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:03.401738 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:03.402946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:03.418098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.418583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.419012 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.419760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.420214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.420630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.484747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:03.485446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:03.496178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.496178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.496178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.496178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.496552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.496552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.596050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:03.605857 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5691e548-25c5-49c4-9331-8533d1bbc3b7 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.208965 Oct 12 12:44:03.606472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 380/784] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:03 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:03.635578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:03.638686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:03.639301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:03.645121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:03.645775 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.646304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.646672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:03.646802 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.647411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:03.647861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dd63da26-73a7-4277-8296-3f5ba583df25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.167782 Oct 12 12:44:03.647980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:03.648277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:03.662020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 405/785] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:03 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:03.780352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:03.788108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c04df596-3f84-4cba-90cd-3205e0b1e01a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.153182 Oct 12 12:44:03.792975 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 381/786] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:03 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:04.628971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:04.629578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:04.632015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=93,nova_api:UPDATE=2,nova_api:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:04.636652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.637133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.637564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.638284 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.638733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.639152 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.672930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:04.673631 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:04.675560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=12 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:04.680873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.681432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.682015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.682800 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.683316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.683946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.771913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:04.779764 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5b6574ca-b32f-453f-be41-25a98d1d99fe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.154682 Oct 12 12:44:04.780510 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 406/787] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:04 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:04.811779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:04.812555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:04.816775 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:04.818529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.819007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.819431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.820111 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:04.820600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:04.820974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:04.825355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:04.826873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:04.828634 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-507ed7a1-75ab-44e4-b76a-6754612549b7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.159158 Oct 12 12:44:04.829434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 382/788] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:04 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:04.963189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:04.970944 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c8dd7493-896c-4aba-b9c8-7157be4cb5ab tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.163011 Oct 12 12:44:04.971503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 407/789] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:04 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:05.803754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:05.804362 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:05.810763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:05.811248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:05.811679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:05.812420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:05.812874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:05.813296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:05.856496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:05.857117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:05.864444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:05.864929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:05.865362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:05.866078 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:05.866536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:05.866962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:05.944275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:05.958004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c22b50a5-a33c-4437-81b2-05d170ae4fbe tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.152342 Oct 12 12:44:05.958004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 383/790] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:05 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:05.997502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:05.998665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:06.005582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:06.005582 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:06.005856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:06.006575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:06.007029 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:06.007144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:06.007455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:06.015327 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:06.017279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:06.018470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f6d18b32-e349-4d9c-b9a2-bbb25dd2f252 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.165850 Oct 12 12:44:06.019023 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 408/791] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:05 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:06.135788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:06.143901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f8e2be56-92f9-48e9-9ba7-0c489db61316 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.150255 Oct 12 12:44:06.144464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 384/792] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:05 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:06.975065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:06.975667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:06.982324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:06.982800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:06.983226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:06.983965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:06.985058 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:06.985526 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:07.048979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:07.049611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:07.056058 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:07.056537 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:07.056966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:07.057651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:07.058139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:07.058558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:07.116351 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:07.124239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a80d431e-9363-4e9e-ac05-7d75643bdbe8 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.153121 Oct 12 12:44:07.124891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 409/793] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:06 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:07.167484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:07.168093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:07.174625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:07.175118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:07.175547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:07.176239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:07.176693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:07.177116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:07.187620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:07.195744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:07.197175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:07.198347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1be1037c-2fc5-45f5-a75e-be13d16bfe2f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.158401 Oct 12 12:44:07.198905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 385/794] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:07 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:07.306748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:07.314331 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-13267256-04d8-481a-90df-4efe1760a084 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.150719 Oct 12 12:44:07.314894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 410/795] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:07 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:08.147426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:08.148036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:08.154437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.154916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.155345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.156421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.156558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.156892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.223506 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:08.224145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:08.230456 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.230953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.231389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.232084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.232541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.232968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.290366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:08.298682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-60417534-ee31-4842-bff2-f80d9da63fae tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.155009 Oct 12 12:44:08.299253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 386/796] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:08 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:08.337176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:08.337676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:08.343884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.344336 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.345154 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.346323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:08.347134 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:08.347643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:08.376430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:08.385064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:08.386612 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:08.387961 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-43f7ba43-c662-4cb9-9853-9a09e97b8d16 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.168288 Oct 12 12:44:08.388916 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 411/797] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:08 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:08.483754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:08.491956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2e182b4b-c21b-4c44-9b02-4a3b6591dd48 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.159266 Oct 12 12:44:08.492519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 387/798] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:08 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:09.322466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:09.323661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:09.329830 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-24851857", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1979552841", "security_groups": [{"name": "tempest-secgroup-smoke-292163129"}], "block_device_mapping_v2": [{"uuid": "3627ae50-3845-4afc-b4a2-be0bdbda7614", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df10711-3511-48ea-bbdd-b691bad6a273"}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:09.330855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.331412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.331916 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.332729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.333391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.334034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.479913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:09.494133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] validate_networks() for [('3df10711-3511-48ea-bbdd-b691bad6a273', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:44:09.494788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c8352966-b25f-4712-b3c9-a1c5abe52909 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1366 microversion: 2.1 time: 0.171767 Oct 12 12:44:09.494788 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 412/799] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:09 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:09.495497 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:09.496129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:09.508114 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.508601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.509219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.509919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.510387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.510964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.654771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:09.665543 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:09.667051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:09.668236 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a834a314-6644-4ca5-8caf-7f00da6dc691 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.176997 Oct 12 12:44:09.669138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 413/800] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:09 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:09.674198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:09.675667 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:09.692107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.692723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.693179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.693884 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.694424 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.694849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.716549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:09.848327 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:09.857246 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-29bc04b7-fc63-458d-b8f6-ca2157ce912e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1568 microversion: 2.1 time: 0.186866 Oct 12 12:44:09.857989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 414/801] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:09 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1568 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:09.883105 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:09.883702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:09.890427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.890914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.891874 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.892698 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.893153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.893572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.902315 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:44:09.902799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:44:09.905140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:44:09.905140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:44:09.905140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:44:09.915667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.916468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.916966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.917893 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:09.918372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:09.918803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:09.936054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:44:09.940229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for user 205b19ccb80a45fd8ed36abd2c4c32c3 and project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:44:10.009214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:44:10.011854 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3627ae50-3845-4afc-b4a2-be0bdbda7614',volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:44:10.055523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130867) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 12:44:10.390351 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3153b538-9eb2-47a1-b69e-a1a665542df1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "POST /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d/action" status: 202 len: 0 microversion: 2.1 time: 0.511054 Oct 12 12:44:10.394622 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 415/802] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:44:09 2022] POST /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d/action => generated 0 bytes in 516 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:44:10.399747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:10.400364 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:10.408067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.408785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.409211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.409896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.410365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.411171 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.432126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fe15b2ba-b678-4279-8c49-1e8ad4855f91 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.106506 Oct 12 12:44:10.439480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 388/803] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:44:09 2022] POST /compute/v2.1/servers => generated 405 bytes in 1114 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:44:10.444798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a2df27a1-1a73-445a-87ba-9e66ccb85bb0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:10.445579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a2df27a1-1a73-445a-87ba-9e66ccb85bb0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:10.524985 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a2df27a1-1a73-445a-87ba-9e66ccb85bb0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.533741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a2df27a1-1a73-445a-87ba-9e66ccb85bb0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1093 microversion: 2.1 time: 0.092967 Oct 12 12:44:10.534933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 389/804] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:10 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1093 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:10.539855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:10.540524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:10.546467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.547191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.547807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.548819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.549497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.550177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.624686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.634370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f1cc5848-23b6-4837-ac1e-f691189d22ac tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1516 microversion: 2.1 time: 0.238339 Oct 12 12:44:10.635245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 416/805] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:10 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1516 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:10.694530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:10.699291 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:10.708984 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.709833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.713542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.713542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.713542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.713542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.719913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.728525 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1d9fcf08-468f-42ee-9565-cd9812b1cf18 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1556 microversion: 2.1 time: 0.192550 Oct 12 12:44:10.730109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 390/806] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:10 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1556 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:10.755250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:10.756128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:10.763346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.763901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.764397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.765163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.765683 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.766723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.855370 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-af62d7a8-41e1-4812-a294-c5eee50194d5 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104642 Oct 12 12:44:10.856600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 391/807] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:44:10 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:44:10.861479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "name": "network-vif-unplugged", "status": "completed", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:10.871965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:10.874011 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:10.874011 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:10.886554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.compute.server_external_events [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] Unable to find a host for instance 6222337e-587d-4200-bcb3-264fc5b2395d. Dropping event network-vif-unplugged {{(pid=130866) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Oct 12 12:44:10.887555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-890957c3-0be2-47c5-816c-2d4681d37506 req-bc9d4e44-b09b-48aa-9173-a69fac3617dd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030026 Oct 12 12:44:10.889191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 392/808] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:10 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Oct 12 12:44:10.907818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.916871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.918604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:10.919891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6b60d4fd-1562-4536-b8f7-e793fc76e896 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.229258 Oct 12 12:44:10.920762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 417/809] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:10 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:11.556276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:11.557106 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:11.564769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.565261 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.565785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:11.566573 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.567093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.567579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:11.587176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:11.659161 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:11.660350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:11.669210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.669823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.670310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:11.671020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.671525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.671946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:11.835782 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:11.856509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-792d06d3-a6ec-444b-8d86-465ec385a185 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1516 microversion: 2.1 time: 0.202235 Oct 12 12:44:11.857097 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 418/810] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:11 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1516 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:11.891970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:11.907594 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e1e3f7be-1fff-4293-870a-29723288764a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1143 microversion: 2.1 time: 0.354239 Oct 12 12:44:11.909056 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 393/811] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:11 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1143 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:11.946385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:11.947043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:11.953542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.954047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.954650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:11.955334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:11.955969 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:11.956389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:12.098237 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:12.106619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:12.108119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:12.109285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0d424c0d-cd1f-4825-b0e5-2ab16493b7fc tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.167133 Oct 12 12:44:12.110379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 419/812] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:11 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:12.185965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29def05a-0aa9-48ba-8880-44b19b216766", "tag": "3af0b0da-4e0e-4354-b176-3e8eda704ca2"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:12.195982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:12.196763 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:12.197460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:12.208230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] Creating event network-changed:3af0b0da-4e0e-4354-b176-3e8eda704ca2 for instance 29def05a-0aa9-48ba-8880-44b19b216766 on hv-cinder-81268 Oct 12 12:44:12.213451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-326422a5-6ad2-4c1a-ba6c-f60c97f8ea50 req-3b983a9c-75bc-42c1-86ef-98d3b449b3a3 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031785 Oct 12 12:44:12.214064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 394/813] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:12.882203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:12.882780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:12.889515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:12.890036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:12.890502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:12.891207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:12.891652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:12.892121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:12.934554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:12.935246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:12.942753 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:12.944316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:12.944316 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:12.944507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:12.944820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:12.945254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:13.045906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:13.056683 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-11fcf0b0-747f-466c-a9d9-0d86e31c3990 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1518 microversion: 2.1 time: 0.178783 Oct 12 12:44:13.057495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 420/814] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:12 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1518 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:13.073837 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:13.084524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3c245c93-8f51-40e7-a418-d739a9f21d16 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1135 microversion: 2.1 time: 0.154026 Oct 12 12:44:13.091864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 395/815] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:12 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1135 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:13.136634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:13.137488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:13.143960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:13.144432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:13.146083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:13.146083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:13.146280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:13.146627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:13.295028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:13.304314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:13.305778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:13.307100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-10e7ba72-1364-43bb-a5a2-1ebc5b42ad9a tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.174716 Oct 12 12:44:13.307655 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 421/816] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:13 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:14.087638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:14.087638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:14.093173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.093653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.094159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.095339 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.095790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.096210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.113466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:14.121452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:14.121452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.121452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.121744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.122457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.123105 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.123791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.210620 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:14.220217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cec5c678-92c0-4bac-a8b8-e5261c157d94 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1199 microversion: 2.1 time: 0.111297 Oct 12 12:44:14.221020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 422/817] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:14 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:14.325320 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:14.334401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c5027934-775d-44a0-98a5-5e248f29ab8e tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.252853 Oct 12 12:44:14.335451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 396/818] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:14 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:14.336577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:14.337283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:14.348900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.349384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.350089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.350953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:14.351517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:14.351953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:14.481899 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:14.490715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:14.492086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:14.493270 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-22e4d561-a1e0-45a2-aa88-31c60f491f25 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.162203 Oct 12 12:44:14.493831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 423/819] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:14 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:15.246584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:15.247897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:15.253901 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:15.260071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.260574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.261067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.262083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.262498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.262950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.359490 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:15.361514 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:15.371116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.371778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.372427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.373592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.374312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.374986 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.471031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:15.479803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-77ff793b-3037-420f-923e-e127d99f89ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1276 microversion: 2.1 time: 0.238393 Oct 12 12:44:15.481176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 397/820] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:15 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1276 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:15.519037 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:15.519733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:15.521692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:15.525575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.526181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.526662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.527350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:15.527797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:15.528250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:15.529599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b5594b83-849e-4fc1-86e6-bd42f3a070c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.175918 Oct 12 12:44:15.530224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 424/821] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:15 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:15.771939 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:15.782981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:15.784704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:15.786057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-07dcbcb8-e239-42e4-8f9c-905f77793ed4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1746 microversion: 2.20 time: 0.271114 Oct 12 12:44:15.786719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 398/822] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:15 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1746 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:15.987859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1", "tag": "033b8a88-95a3-4f47-bd2f-1ac25dfe152e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:16.001353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.001827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.003457 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.014541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] Creating event network-changed:033b8a88-95a3-4f47-bd2f-1ac25dfe152e for instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 on hv-cinder-81268 Oct 12 12:44:16.021146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-c8ca3cd5-6efd-4564-9ca3-16be003f26e4 req-791f3f02-a177-456e-b6f5-e74598b730f8 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036805 Oct 12 12:44:16.021768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 425/823] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:16.504895 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:16.505509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:16.512482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.513039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.513539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.514337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.514884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.515373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.555229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:16.555967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:16.562836 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.564032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.564473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.565167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.565634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.566057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.708671 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:16.717007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bbbcd446-7b91-43d6-afb0-b4cdb5426de9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.165909 Oct 12 12:44:16.727184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 426/824] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:16 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:16.747433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:16.757216 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-51084d77-8acd-4ad9-ab88-91d89c34b57b tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.256640 Oct 12 12:44:16.757805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 399/825] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:16 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:16.814557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:16.815541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:16.824000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.824778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.825451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.831028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:16.831028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:16.831028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:16.998660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:17.008187 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:17.009813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:17.014951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a1f195cc-03ed-43c4-b536-d9ae72ec53f9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1746 microversion: 2.20 time: 0.202171 Oct 12 12:44:17.014951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 427/826] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:16 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1746 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:17.739575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:17.740215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:17.746818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:17.747300 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:17.747737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:17.748681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:17.749133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:17.749574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:17.779742 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:17.780353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:17.787823 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:17.788308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:17.788737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:17.789428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:17.789874 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:17.790319 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:17.881177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:17.888999 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8c792166-8606-4105-af53-e7deaa9e9144 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.153868 Oct 12 12:44:17.889916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 400/827] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:17 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:17.927048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:17.933646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-34d65d29-8b46-46c7-9c84-ff35b6c9a188 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.157972 Oct 12 12:44:17.934493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 428/828] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:17 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:18.036752 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:18.037437 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:18.043423 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:18.043894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:18.044360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:18.045039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:18.045489 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:18.045909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:18.183932 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:18.192213 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:18.193672 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:18.194862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-50adabd5-55c0-4141-9576-adc2adb98734 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1746 microversion: 2.20 time: 0.162026 Oct 12 12:44:18.195434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 401/829] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:18 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1746 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:18.912162 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:18.912892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:18.919634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:18.920466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:18.921101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:18.921869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:18.922411 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:18.922894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:18.934229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "name": "network-vif-plugged", "status": "completed", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:18.953462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:18.954054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:18.954727 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:18.975881 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] Creating event network-vif-plugged:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:44:18.981765 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-4053b1bf-71de-479d-b8c6-793b59062507 req-15acbee3-ab00-47ec-812c-f0ffbd177438 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050995 Oct 12 12:44:18.986166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 402/830] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:44:18.992864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:18.993696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:19.001604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:19.002330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:19.002887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:19.003916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:19.005304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:19.005986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:19.125112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:19.137393 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-65c32360-4cef-459e-a60d-17dc7ed6a4f8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.228951 Oct 12 12:44:19.150083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 429/831] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:18 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:19.201420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:19.210645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fa391be9-1cee-43e4-8a8d-cda458b21fbe tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.222232 Oct 12 12:44:19.212644 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 403/832] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:18 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:19.223835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:19.224432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:19.231962 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:19.234231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:19.236067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:19.237040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:19.237809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:19.238523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:19.388379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:19.391020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:19.400829 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:19.402338 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:19.403770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d113b6e1-53f9-4c0f-96b6-d914451ba7af tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.184367 Oct 12 12:44:19.405968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 430/833] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:19 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:20.165268 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:20.165987 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:20.170659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:20.177212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.178075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.178757 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.179817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.180417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.180864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.240567 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:20.241348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:20.253483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.258099 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.258843 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.260522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.261907 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.262708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.340159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:20.366324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-80eb8230-681f-4141-9330-b8e5a0e3de94 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.193510 Oct 12 12:44:20.366324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 404/834] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:20 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:20.430620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:20.431231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:20.440031 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.440526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.440973 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.441657 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:20.444349 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:20.445260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:20.453406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:20.464685 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3c5f1728-a180-4260-955a-529a1fbb3ef6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.228354 Oct 12 12:44:20.465618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 431/835] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:20 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:20.530087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=8 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:20.626330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:20.640560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:20.644273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:20.646676 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-26fb5bed-eacb-4812-8a03-7ddbbd76bb0e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.218777 Oct 12 12:44:20.660062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 405/836] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:20 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:21.386416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:21.388204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:21.396051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.396805 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.397245 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.398309 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.398789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.399208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.489902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:21.490633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:21.499539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.500173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.501279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.502130 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.502651 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.503142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.559150 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:21.567753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2fcc770b-4f41-443c-8ccb-b85c5396a27c tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.186959 Oct 12 12:44:21.568530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 432/837] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:21 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:21.642826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:21.651050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4bacd805-d96d-43f8-82b8-286846bd919e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.166354 Oct 12 12:44:21.669234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 406/838] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:21 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:21.681292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:21.681978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:21.689400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.690095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.690978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.691855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:21.692459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:21.693068 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:21.847252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:21.856670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:21.858890 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:21.859435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-141954f5-645b-426e-be5e-d4f65b3ee35e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.189247 Oct 12 12:44:21.860718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 433/839] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:21 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:22.593474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:22.594954 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:22.601399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.601876 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.602416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:22.603122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.603599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.604017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:22.673596 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:22.674249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:22.683189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.683652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.684083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:22.684789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.685242 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.685666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:22.778798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:22.787290 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1489e550-4539-4236-9598-eaa9f67a6317 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.200379 Oct 12 12:44:22.798508 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 407/840] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:22 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:22.852120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:22.860976 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-defb7dc6-1025-44e0-a23b-60f9b554c3a0 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.191803 Oct 12 12:44:22.870413 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 434/841] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:22 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:22.886696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:22.888038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:22.895891 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.896391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.896826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:22.897535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:22.898014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:22.898637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:23.089145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:23.099081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:23.104390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:23.104390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-fe364b13-3e05-475b-9a38-79810cc0949f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.219381 Oct 12 12:44:23.104390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 408/842] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:22 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:23.814354 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:23.815508 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:23.825573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:23.826396 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:23.827341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:23.828694 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:23.829650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:23.830563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:23.887739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:23.888968 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:23.897081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:23.897910 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:23.898505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:23.899301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:23.899951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:23.900376 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:23.987311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:23.999264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fe17c7f2-3939-42c1-8ace-83c33aa96741 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.191246 Oct 12 12:44:23.999849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 435/843] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:23 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:24.054793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:24.063786 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7d4a0271-9e9c-49d0-ac6b-f12e9a61cadb tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.181500 Oct 12 12:44:24.078441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 409/844] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:23 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:24.127876 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:24.128992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:24.135180 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:24.135660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:24.136268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:24.137124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:24.137744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:24.138363 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:24.289106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:24.298684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:24.299919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:24.301381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0f8f1e6f-cd74-42ac-b0db-14b169e4e563 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.177885 Oct 12 12:44:24.302148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 436/845] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:24 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:25.023610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:25.024329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:25.030904 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.031391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.032449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.033259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.033720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.034172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.077784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "name": "network-vif-plugged", "status": "completed", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:25.092232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.092232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.092232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.108238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] Creating event network-vif-plugged:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:44:25.115034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-b1912b11-2741-4fed-8e0a-aa587fc15030 req-c1c77319-27ad-42bb-9586-20b4715456f7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041908 Oct 12 12:44:25.116060 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 437/846] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:25.121153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:25.121964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:25.130093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.136436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.136436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.136436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.136436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.137015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.277439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:25.290838 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d8db54d2-0b7a-4a06-b2fa-6a7d0ef4ee3a tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.270609 Oct 12 12:44:25.291621 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 410/847] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:25 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:25.306171 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:25.312382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-461fe8b1-e133-4d0b-88a1-ac7fde0fd079 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.195126 Oct 12 12:44:25.323618 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 438/848] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:25 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:25.331511 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:25.332334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:25.338833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.339704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.340193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.341123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:25.341610 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:25.342066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:25.366422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=100 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:25.581332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:25.595810 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:25.600473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:25.603235 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-761ff876-fd10-4604-98db-446b8622689f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.276798 Oct 12 12:44:25.618399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 411/849] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:25 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:26.315752 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:26.316447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:26.325192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.325952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.326720 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.327429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.328072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.329156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.347844 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:26.349673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:26.358902 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.359776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.360725 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.361805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.362549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.363193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.679866 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:26.689400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5862be3e-c3ff-4070-9c59-a3973d0c02c1 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1574 microversion: 2.1 time: 0.377467 Oct 12 12:44:26.708098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:26.717016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-64e3ccde-4b4f-4cba-a322-ad14cb5fcda2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.376181 Oct 12 12:44:26.717989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 439/851] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:26 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1574 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:26.718138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 412/851] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:26 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:26.724754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:26.727188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:26.733797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.734506 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.735674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.736522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:26.737096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:26.737656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:26.903584 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:26.919460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:26.919460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:26.919460 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-11036cd0-0e28-4990-a389-f226dede1315 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.197160 Oct 12 12:44:26.919789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 440/852] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:26 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:27.145156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1", "name": "network-vif-plugged", "status": "completed", "tag": "033b8a88-95a3-4f47-bd2f-1ac25dfe152e"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:27.158690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.159170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.159604 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.185821 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] Creating event network-vif-plugged:033b8a88-95a3-4f47-bd2f-1ac25dfe152e for instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 on hv-cinder-81268 Oct 12 12:44:27.210224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-071ff060-c1a5-41fe-bc2e-cf47adc1c302 req-b461a65e-9585-41a7-b590-ac0401037ea4 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065510 Oct 12 12:44:27.213079 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 413/853] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:27.718263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:27.719689 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:27.729637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.730448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.731052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.732640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.733593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.734306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.747951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:27.748965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:27.764497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.766149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.767284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.770118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.770780 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.771375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.944801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:27.956959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-685e9640-2480-4b3e-997a-7597cdc30a81 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1561 microversion: 2.1 time: 0.239910 Oct 12 12:44:27.956959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 441/854] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:27 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1561 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:27.957172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:27.962840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:27.963747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:27.964668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1a048713-eb97-4825-9b0b-0eea0dc605fc tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.224215 Oct 12 12:44:27.968724 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 414/855] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:27 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:27.976137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.977191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.977867 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:27.978780 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:27.979466 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:27.980146 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:28.125791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:28.136178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:28.137749 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:28.139202 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bd41adc6-a876-4b7a-963f-cb8a690e5ac4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.184399 Oct 12 12:44:28.139897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 442/856] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:27 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:28.989682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:28.990264 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:28.996579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:28.997059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:28.997490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:28.998205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:28.999090 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:29.001014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:29.145997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:29.153645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-42a98c0a-5e05-4efb-99c2-9525cc01c71f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.168592 Oct 12 12:44:29.154548 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 415/857] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:28 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:29.164840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:29.165730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:29.173072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:29.173703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:29.174234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:29.174997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:29.175522 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:29.176007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:29.306928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:29.315952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:29.317422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:29.318676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-80b83565-c62a-4d75-9d94-67c75ea5830f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.157983 Oct 12 12:44:29.319260 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 443/858] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:29 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:30.176449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:30.177068 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:30.183463 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:30.183946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:30.184380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:30.185099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:30.185554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:30.186002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:30.315372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:30.322986 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2600673e-548d-4407-bac6-6b4c110c8fa3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.150401 Oct 12 12:44:30.323478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 416/859] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:30 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:30.344600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:30.345849 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:30.352171 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:30.352639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:30.353064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:30.353745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:30.354219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:30.354634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:30.483518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:30.491561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:30.493050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:30.494239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-832fc9b2-a709-470e-a752-8b2bb561dd67 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.153579 Oct 12 12:44:30.494795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 444/860] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:30 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:31.346343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:31.346956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:31.353311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:31.353797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:31.354340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:31.355030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:31.355484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:31.355906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:31.481814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:31.491046 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6056a47f-cc97-443f-a808-4e48705ddd27 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.149225 Oct 12 12:44:31.491600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 417/861] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:31 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:31.520308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:31.521050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:31.527251 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:31.527730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:31.528160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:31.528848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:31.529300 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:31.529719 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:31.654124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:31.662804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:31.664248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:31.665398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a26e8b6c-d185-4894-b64e-cb30853a01e7 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.149424 Oct 12 12:44:31.665973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 445/862] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:31 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:32.514368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:32.515004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:32.521654 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:32.522161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:32.522592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:32.523267 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:32.523714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:32.524128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:32.652060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:32.660123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-46e0d65f-a39d-468d-b172-06c4567cad64 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.149557 Oct 12 12:44:32.660678 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 418/863] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:32 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:32.690157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:32.690760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:32.697051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:32.697523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:32.697971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:32.698647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:32.699091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:32.699503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:32.828095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:32.836179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:32.837658 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:32.838842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1567f2d3-a8f1-4b5b-8e33-7d8e6a0d8fa3 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.152544 Oct 12 12:44:32.839405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 446/864] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:32 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:33.683043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:33.683649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:33.690897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:33.691629 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:33.692066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:33.692748 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:33.693191 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:33.693603 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:33.824820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:33.832467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-95450fcc-d748-453e-a68d-ee6ab9293f03 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.153278 Oct 12 12:44:33.833025 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 419/865] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:33 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:33.864606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:33.865209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:33.871628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:33.872122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:33.872551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:33.873234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:33.873954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:33.874385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:34.000251 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:34.009190 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:34.010768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:34.011920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dadd1745-4cca-4f56-a7e5-cc616499eee9 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1741 microversion: 2.20 time: 0.151661 Oct 12 12:44:34.012481 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 447/866] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:33 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1741 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:34.855467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:34.856074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:34.862693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:34.863187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:34.863622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:34.864353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:34.864808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:34.865238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:35.037445 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:35.038211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:35.045072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:35.045638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:35.046271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:35.047063 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:35.047704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:35.048136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:35.051552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:35.092770 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:35.102369 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-189987b9-d447-4940-b68d-34aeff91b143 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1264 microversion: 2.1 time: 0.250575 Oct 12 12:44:35.103236 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 420/867] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:34 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1264 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:35.204101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:35.213079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:35.214621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:35.215790 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-33270819-66df-4df9-a99c-8e2e715538e8 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1723 microversion: 2.20 time: 0.182520 Oct 12 12:44:35.216416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 448/868] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:35 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:36.125911 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:36.127199 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:36.133557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.134062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.134492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.135223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.135668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.136089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.242929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:36.243562 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:36.245903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:36.251841 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.252348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.252779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.253473 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.253922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.254547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.267572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:36.275275 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8dfe8aa3-f084-47d4-a3d8-ee0f6ff21128 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1452 microversion: 2.1 time: 0.153526 Oct 12 12:44:36.275865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 421/869] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:36 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:44:36.297138 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:36.297745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:36.304456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.304933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.305360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.306074 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.306574 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.306999 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.384229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:36.392692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:36.394192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:36.395342 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f7654977-bfa3-49b8-add5-355e128a0adb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1723 microversion: 2.20 time: 0.156621 Oct 12 12:44:36.395894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 449/870] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:36 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:36.436474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:36.444114 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-61542ca7-b8a9-4a29-bd31-f3c62841dfd2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1452 microversion: 2.1 time: 0.150888 Oct 12 12:44:36.444668 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 422/871] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:44:36 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:44:36.950292 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "name": "network-vif-unplugged", "status": "completed", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:36.960312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:36.961117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:36.963561 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:36.973149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] Creating event network-vif-unplugged:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:44:36.978335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-f4ed7679-f390-437c-9d7e-2e9df871aac8 req-bdf72227-0d0b-4759-be80-dad495e6a31a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031587 Oct 12 12:44:36.979014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 450/872] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:36 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:37.420765 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:37.421512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:37.428503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:37.430686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:37.430686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:37.430686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:37.430686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:37.431242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:37.569175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:37.579015 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:37.581799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:37.583121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2376fd99-5b62-4525-b8fb-c36f62ba680c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1723 microversion: 2.20 time: 0.166387 Oct 12 12:44:37.584099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 423/873] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:37 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:38.609977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:38.611502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:38.622905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:38.622905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:38.622905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:38.622905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:38.624439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:38.624439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:38.768252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1", "tag": "033b8a88-95a3-4f47-bd2f-1ac25dfe152e"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:38.779405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:38.780039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:38.780526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:38.792032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:38.792222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] Creating event network-changed:033b8a88-95a3-4f47-bd2f-1ac25dfe152e for instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 on hv-cinder-81268 Oct 12 12:44:38.797263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-b51a37fe-5363-4fd4-96cc-01ce13b94b14 req-42796edf-532b-4c65-94ab-59277f6d8bac service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033627 Oct 12 12:44:38.798405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 424/874] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:44:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:44:38.802647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:38.804175 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:38.805421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f1776255-275e-49fd-a748-8511f6454b4b tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1666 microversion: 2.20 time: 0.200400 Oct 12 12:44:38.806073 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 451/875] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:38 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1666 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:38.832132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87a4a70c-f2cb-426a-b848-4e1e3d867446"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:38.834670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:38.841205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:38.841776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:38.842323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:38.843103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:38.843633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:38.844126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:39.777075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f249dcb3-bc74-46a5-a0d0-680d3b99b88e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.949790 Oct 12 12:44:39.783878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 425/876] 10.222.0.44 () {62 vars in 1364 bytes} [Wed Oct 12 12:44:38 2022] POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments => generated 188 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Oct 12 12:44:39.907487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:39.908494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:39.915043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:39.915529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:39.915967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:39.916674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:39.917132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:39.917552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:40.491029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a5731fdd-d4ab-4d4e-b40a-f80d15f41b7e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments/87a4a70c-f2cb-426a-b848-4e1e3d867446" status: 202 len: 0 microversion: 2.20 time: 0.587374 Oct 12 12:44:40.491632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 452/877] 10.222.0.44 () {60 vars in 1457 bytes} [Wed Oct 12 12:44:39 2022] DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments/87a4a70c-f2cb-426a-b848-4e1e3d867446 => generated 0 bytes in 589 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:44:40.552222 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:40.552805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:40.559541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:40.560039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:40.560477 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:40.561167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:40.561791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:40.562237 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:40.592190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=130866) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Oct 12 12:44:40.667481 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:40.779163 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9744fd29-b9d5-4d0a-98a5-38f98c2d92c1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/action" status: 202 len: 0 microversion: 2.20 time: 0.231238 Oct 12 12:44:40.780592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 426/878] 10.222.0.44 () {62 vars in 1319 bytes} [Wed Oct 12 12:44:40 2022] POST /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/action => generated 0 bytes in 233 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Oct 12 12:44:40.787783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:40.788390 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:40.794761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:40.795249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:40.795681 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:40.796374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:40.796825 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:40.797249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:40.929131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:40.938796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:40.940241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:40.941524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c296bee8-86e6-4e66-8b65-ac0feb05b065 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1674 microversion: 2.20 time: 0.157629 Oct 12 12:44:40.946246 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 453/879] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:40 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1674 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:41.966696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:41.967308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:41.974515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:41.975021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:41.975494 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:41.976236 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:41.976637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:41.977059 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:42.110306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:42.119536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:42.121021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:42.122545 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-50cc17e6-ccd4-4a35-a4fd-89145040b59e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1676 microversion: 2.20 time: 0.159935 Oct 12 12:44:42.126025 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 427/880] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:41 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1676 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:43.151039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:43.151654 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:43.158633 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:43.159115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:43.159556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:43.160258 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:43.160905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:43.161340 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:43.296989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:43.305047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:43.306524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:43.307705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3e59f50d-15b5-4aaa-aa7c-455a612191bb tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.160680 Oct 12 12:44:43.308269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 454/881] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:43 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:44.334663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:44.335242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:44.342065 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:44.342559 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:44.342997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:44.343692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:44.344151 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:44.344579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:44.473050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:44.481554 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:44.483073 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:44.484245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6a877abd-cfe0-4e95-a95c-1dd15481a225 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.154317 Oct 12 12:44:44.484979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 428/882] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:44 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:45.510178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:45.510783 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:45.517173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:45.517668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:45.518143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:45.518824 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:45.519269 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:45.519686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:45.643153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:45.651137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:45.652578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:45.653726 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b34f0cb2-ddc4-4fd6-8d90-6dbbfa8ab468 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.147528 Oct 12 12:44:45.654304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 455/883] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:45 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:46.679681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:46.680887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:46.683288 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:44:46.688012 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:46.688497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:46.688931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:46.689889 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:46.690363 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:46.690820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:46.844111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:46.852381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:46.853836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:46.855035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-13615d41-042b-4288-9512-18ca5574a809 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.179337 Oct 12 12:44:46.855812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 429/884] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:46 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:47.881332 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:47.881961 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:47.888831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:47.889327 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:47.889760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:47.890497 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:47.891149 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:47.891570 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:48.028668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:48.037062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:48.038533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:48.039700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-17d21ca7-0687-4829-9add-839714564386 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.163593 Oct 12 12:44:48.040259 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 456/885] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:47 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:48.586944 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:48.587477 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:48.594353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:48.595172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:48.595810 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:48.596704 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:48.597852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:48.598503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:48.624577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a1c76963-fff4-4a46-bc5d-2526a94c2b95 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/ips" status: 200 len: 149 microversion: 2.1 time: 0.041191 Oct 12 12:44:48.625100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 430/886] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:44:48 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:49.080099 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:49.082110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:49.089516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:49.090020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:49.090453 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:49.091148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:49.091600 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:49.092013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:49.255058 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:49.267391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:49.270954 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:49.276593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c8f3f00a-a49e-4e1d-aef7-f40a62a29daa tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.214610 Oct 12 12:44:49.277259 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 457/887] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:49 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:50.305608 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:50.306273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:50.313083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:50.313562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:50.314265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:50.314965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:50.315416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:50.316486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:50.454826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:50.463075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:50.464432 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:50.465569 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e080f446-8b2c-442f-ab9a-7190ccb4f373 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.164112 Oct 12 12:44:50.466142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 431/888] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:50 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:51.337691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5996a657-076d-4c15-81a0-442721013b8d"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:44:51.340156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:51.346718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:51.347211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:51.347680 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:51.348377 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:51.348837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:51.349261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:51.491355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:51.491951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:51.499831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:51.500313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:51.500742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:51.501440 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:51.501892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:51.502342 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:51.647536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:51.655636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:51.657081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:51.658253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-579ca466-1531-408a-abb1-50299b341d10 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.171171 Oct 12 12:44:51.658808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 432/889] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:51 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:52.687297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:52.688166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:52.695587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:52.696414 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:52.697055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:52.697871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:52.698364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:52.698781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:52.866178 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:52.875779 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:52.878346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:52.880726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-af67b7c3-377d-4003-af85-77d5b0e6ee37 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.198393 Oct 12 12:44:52.896365 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 433/890] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:52 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:44:53.908849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:53.909605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:53.916167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:53.922023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:53.922023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:53.922023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:53.922023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:53.922483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:54.067804 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:54.079920 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:54.081741 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:54.084029 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b947dee2-8f73-4871-be2d-997ce7be9bee tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.178718 Oct 12 12:44:54.085433 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 434/891] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:53 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:55.202081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:55.202081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:55.202081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:55.202081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:55.203066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:55.203066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:55.203066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:55.203066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:55.262439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:55.271442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:55.272897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:55.274087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8bed5556-b7d6-437c-a0bb-d35ed73031d1 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.167216 Oct 12 12:44:55.274693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 435/892] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:55 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:56.299779 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:56.300499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:56.307471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:56.307865 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:56.308595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:56.309311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:56.309759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:56.310197 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:56.465491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:56.475179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:56.476807 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:56.478139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-462521ef-944d-4cf2-ad5d-b2e330bd5467 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.182656 Oct 12 12:44:56.478827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 436/893] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:56 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:57.506040 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:57.506784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:57.513352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:57.513827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:57.514283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:57.514966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:57.515413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:57.515831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:57.647230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:57.655506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:57.656946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:57.658133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-757b9e47-3fc9-4ecd-bdb8-332195055743 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.156429 Oct 12 12:44:57.658683 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 437/894] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:57 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:58.682882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:58.683561 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:58.689730 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:58.690231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:58.690659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:58.691337 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:58.691826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:58.692255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:58.754064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1b0bc6a9-8b53-4c91-b6e1-78ce1e558b6e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "POST /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.420162 Oct 12 12:44:58.755353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 458/895] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:44:51 2022] POST /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 194 bytes in 7423 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:44:58.837675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:58.846428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:58.847883 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:44:58.849087 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5d628c32-3dc8-4d4c-a057-eb0d49ac4961 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.170073 Oct 12 12:44:58.849666 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 438/896] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:58 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Oct 12 12:44:59.876518 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:44:59.877218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:44:59.883412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:59.883889 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:59.884320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:44:59.885005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:44:59.885538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:44:59.886324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:00.013881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:00.022449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:00.023891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:00.025051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0b1de258-34cf-45f6-ac8e-b0b513769001 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.153824 Oct 12 12:45:00.025607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 459/897] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:44:59 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:01.051718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:01.052827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:01.059334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:01.059820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:01.060253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:01.060946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:01.061402 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:01.061826 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:01.150977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "name": "network-vif-plugged", "status": "completed", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:01.165019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:01.165019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:01.165019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:01.175188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] Creating event network-vif-plugged:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:45:01.182385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-db99fe78-c726-43a0-860c-600dade5594b req-bc7af281-09ac-4885-bfb0-a912bc7e9843 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Oct 12 12:45:01.182385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 460/898] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:45:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:01.225366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:01.244843 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:01.246720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:01.251823 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-25a29a37-cd2a-4b68-833c-fac66a0e2e5f tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.200518 Oct 12 12:45:01.251823 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 439/899] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:01 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:02.276368 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:02.277079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:02.283187 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:02.283668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:02.284095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:02.284774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:02.285222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:02.285637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:02.423546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:02.432308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:02.433793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:02.435011 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0e04cb4c-35b7-4f8a-93fa-2ac4b1f06941 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.163934 Oct 12 12:45:02.435563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 461/900] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:02 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:03.460979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:03.461712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:03.468438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:03.468916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:03.469352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:03.470076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:03.470529 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:03.470947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:03.598857 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:03.606976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:03.608455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:03.609602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-53b732da-b7b6-4bfa-844a-4bc52a987f6c tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1732 microversion: 2.20 time: 0.153528 Oct 12 12:45:03.610219 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 440/901] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:03 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:04.635140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:04.636313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:04.641925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:04.642639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:04.643070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:04.643768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:04.644216 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:04.644633 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:04.650949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:04.777212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:04.785028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:04.786575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:04.788334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5af008ff-b1a9-44ee-affd-5a454ffc349e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1719 microversion: 2.20 time: 0.157625 Oct 12 12:45:04.788883 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 462/902] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:04 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1719 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:09.565462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:09.565970 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:09.572874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:09.573345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:09.573767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:09.574480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:09.574927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:09.575345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:09.654082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'services' on Instance uuid 29def05a-0aa9-48ba-8880-44b19b216766 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:45:09.840240 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b98f3d2b-9a78-4687-962b-3a186b941c1c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments/5996a657-076d-4c15-81a0-442721013b8d" status: 202 len: 0 microversion: 2.1 time: 0.278428 Oct 12 12:45:09.840818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 441/903] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:45:09 2022] DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments/5996a657-076d-4c15-81a0-442721013b8d => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:45:09.849408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:09.851862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:09.854773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=28 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:09.861604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:09.861604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:09.861604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:09.861927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:09.862287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:09.862715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:09.894170 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3f3294c0-26b4-48d1-a02f-17e66541527a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048671 Oct 12 12:45:09.894735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 463/904] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:45:09 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:10.908750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:10.911017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:10.917234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:10.917711 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:10.918177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:10.918879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:10.919328 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:10.919744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:10.923404 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:10.949824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a23e6f27-30df-4f11-a4c8-6536d57f500d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046019 Oct 12 12:45:10.950417 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 442/905] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:45:10 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:11.963235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:11.965433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:11.972399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:11.972879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:11.973313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:11.974021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:11.974533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:11.974979 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:12.004915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ae6069a8-55cb-4e9c-a628-40a7f419e39a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047023 Oct 12 12:45:12.005477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 464/906] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:45:11 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:13.019661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:13.021851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:13.028483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:13.028966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:13.029399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:13.030130 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:13.030583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:13.031002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:13.061914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a4084169-7b53-491c-833d-e96d45d7b3a2 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049103 Oct 12 12:45:13.062504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 443/907] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:45:13 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:14.074864 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:14.077002 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:14.084067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.089628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.089628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.089628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.089628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.090009 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.117566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-64af8a86-210d-4b90-aaf4-cdf7b2e3fb54 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046739 Oct 12 12:45:14.122301 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 465/908] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:45:14 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:45:14.183509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:14.184014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:14.191022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.191504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.191946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.192643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.193100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.193527 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.220587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:45:14.452552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3f181679-26f9-4e30-9c06-bff32450b2bd tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 204 len: 0 microversion: 2.1 time: 0.273479 Oct 12 12:45:14.453142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 444/909] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:14 2022] DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:45:14.461263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:14.461879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:14.467717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.468198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.468630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.469312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:14.469763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:14.470205 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:14.598697 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:14.607166 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b0c94c70-be72-4fea-b4c2-2fcc16eb2a64 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1680 microversion: 2.1 time: 0.149690 Oct 12 12:45:14.613308 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 466/910] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:14 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:15.631373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:15.632071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:15.639759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:15.640187 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:15.640620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:15.641306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:15.641756 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:15.642273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:15.773691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:15.781670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c6e530b2-6db0-4fec-9541-0bc9e1afda39 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1680 microversion: 2.1 time: 0.154521 Oct 12 12:45:15.782253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 445/911] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:15 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:16.805438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:16.806067 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:16.812577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:16.813055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:16.813485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:16.814193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:16.814643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:16.815069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:16.949235 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:16.957009 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9b73aa3c-1b25-4cc9-aea3-360c99b5dc3e tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1680 microversion: 2.1 time: 0.156113 Oct 12 12:45:16.957605 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 467/912] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:16 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1680 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:17.284948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29def05a-0aa9-48ba-8880-44b19b216766", "name": "network-vif-deleted", "tag": "3af0b0da-4e0e-4354-b176-3e8eda704ca2"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:17.292179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:17.297290 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:17.297766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:17.298224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:17.309752 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] Creating event network-vif-deleted:3af0b0da-4e0e-4354-b176-3e8eda704ca2 for instance 29def05a-0aa9-48ba-8880-44b19b216766 on hv-cinder-81268 Oct 12 12:45:17.314961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-5d8f9f15-e13e-409a-9f5f-8085611278c7 req-4378784b-0021-4e7f-89cd-538ea5e6f5ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034193 Oct 12 12:45:17.315484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 446/913] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:17.980216 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:17.980833 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:17.987317 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:17.987803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:17.988237 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:17.988933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:17.989399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:17.989814 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:18.023016 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:18.024092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:18.024542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:18.024995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'fault' on Instance uuid 29def05a-0aa9-48ba-8880-44b19b216766 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:45:18.067938 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:18.077263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-93b1c0fe-afad-4401-9c67-9237042ddfdc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1331 microversion: 2.1 time: 0.100976 Oct 12 12:45:18.077926 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 468/914] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:17 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:19.102280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:19.102973 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:19.109493 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:19.109994 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:19.110465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:19.114398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:19.114398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:19.114398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:19.143056 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:19.143458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:19.143882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:19.144318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lazy-loading 'fault' on Instance uuid 29def05a-0aa9-48ba-8880-44b19b216766 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:45:19.187751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39543aedd1834f68a9d0a4ef174822c2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fb8207ad9abf449b99382a2586d4588a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:19.195431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8982e858-4d96-4647-847e-87807913cf3b tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 200 len: 1331 microversion: 2.1 time: 0.098777 Oct 12 12:45:19.195989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 447/915] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:19 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 1331 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:20.226860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:20.226860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:20.226860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:20.226860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:20.227706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:20.227706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:20.227706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:20.227706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:20.240604 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 HTTP/1.1 Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:20.242756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:20.244474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '29def05a-0aa9-48ba-8880-44b19b216766'} Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:20.245398 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:20.247022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:20.248703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:20.248703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-12e7890e-fe05-4823-bb50-ea5886e95832 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 404 len: 111 microversion: 2.1 time: 0.030173 Oct 12 12:45:20.248703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 469/916] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:20 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:20.253152 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-80e43f84-2934-4193-9f65-498810213cc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '.version_select at 0x7f9805279ee0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:20.350542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-80e43f84-2934-4193-9f65-498810213cc3 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304304595" status: 202 len: 0 microversion: 2.1 time: 0.101355 Oct 12 12:45:20.351127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 448/917] 10.222.0.44 () {58 vars in 1221 bytes} [Wed Oct 12 12:45:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1304304595 => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:45:22.346974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:22.347485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:22.354529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:22.355006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:22.355438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:22.356119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:22.356574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:22.356992 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:22.370928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 HTTP/1.1 Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:22.371853 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.373426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '29def05a-0aa9-48ba-8880-44b19b216766'} Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:22.377626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.379226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.380422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:22.380422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c57dda90-7382-48aa-9562-b6cd09e3b30c tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 404 len: 111 microversion: 2.1 time: 0.030195 Oct 12 12:45:22.380422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 470/918] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:22 2022] DELETE /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:22.382507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:22.383166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 29def05a-0aa9-48ba-8880-44b19b216766] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:22.389658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:22.392732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:22.392732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:22.392732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:22.392732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:22.393167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:22.405520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 HTTP/1.1 Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:22.407177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.408703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '29def05a-0aa9-48ba-8880-44b19b216766'} Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:22.409533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. Oct 12 12:45:22.411039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:22.412351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 29def05a-0aa9-48ba-8880-44b19b216766 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:22.412351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-62db2f98-df12-450d-8739-9d556716ca2d tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766" status: 404 len: 111 microversion: 2.1 time: 0.030357 Oct 12 12:45:22.412351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 449/919] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:22 2022] GET /compute/v2.1/servers/29def05a-0aa9-48ba-8880-44b19b216766 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:23.694425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:23.694920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:23.701231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.701699 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.702169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.702852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.703299 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.703712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.717022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 HTTP/1.1 Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:23.718572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.719995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '6e830ef8-8de0-4618-a5f7-173036554be9'} Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:23.720753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.721995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.723228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:23.723228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-951b5bc4-3d2e-4863-b8ed-dedce346279a tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 404 len: 111 microversion: 2.1 time: 0.029390 Oct 12 12:45:23.723228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 471/920] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:23 2022] DELETE /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:23.728892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:23.729504 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 6e830ef8-8de0-4618-a5f7-173036554be9] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:23.736022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.736502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.736931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.737615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.738086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.738506 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.752813 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 HTTP/1.1 Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:23.754547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.755918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '6e830ef8-8de0-4618-a5f7-173036554be9'} Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:23.756774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. Oct 12 12:45:23.758108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.759166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 6e830ef8-8de0-4618-a5f7-173036554be9 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:23.759166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5f4612e8-147d-43ce-ac38-9adf4f61ee48 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9" status: 404 len: 111 microversion: 2.1 time: 0.031359 Oct 12 12:45:23.759166 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 450/921] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:23 2022] GET /compute/v2.1/servers/6e830ef8-8de0-4618-a5f7-173036554be9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:45:23.764709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:23.765216 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:23.771135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.771616 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.772048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.772738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.773250 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.773608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.786861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 HTTP/1.1 Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:23.788387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.790531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'e3a51ad5-ef04-4f25-961e-6705be7abc42'} Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:23.791388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.792915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.794496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:23.794496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6218dfa4-59b2-46c6-a052-9924932a8614 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 404 len: 111 microversion: 2.1 time: 0.029494 Oct 12 12:45:23.794496 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 472/922] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:23 2022] DELETE /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:23.799611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:23.800219 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: e3a51ad5-ef04-4f25-961e-6705be7abc42] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:23.806743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.807270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.807630 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.808306 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:23.808758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:23.809176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:23.822415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 HTTP/1.1 Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:23.823909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.825408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'e3a51ad5-ef04-4f25-961e-6705be7abc42'} Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:23.826294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. Oct 12 12:45:23.827777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:23.829066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance e3a51ad5-ef04-4f25-961e-6705be7abc42 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:23.829066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9e22fb94-5a9a-45c6-b9b6-79f89877aa58 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42" status: 404 len: 111 microversion: 2.1 time: 0.029439 Oct 12 12:45:23.829066 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 451/923] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:23 2022] GET /compute/v2.1/servers/e3a51ad5-ef04-4f25-961e-6705be7abc42 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:25.086735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:25.090632 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:25.093647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:25.094196 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:25.094634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:25.095322 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:25.095771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:25.096193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:25.110283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca HTTP/1.1 Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:25.111887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.113452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '283eb4f3-2765-48cc-9bee-2178c185deca'} Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:25.114447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.115914 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.117920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:25.117920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-dee12d08-ae18-4418-beff-fe538c844766 tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 404 len: 111 microversion: 2.1 time: 0.030431 Oct 12 12:45:25.117920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 473/924] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:25 2022] DELETE /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:25.123400 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:25.123955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] [instance: 283eb4f3-2765-48cc-9bee-2178c185deca] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:25.130352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:25.137483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:25.137483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:25.137483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:25.137483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:25.138103 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:25.146879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] HTTP exception thrown: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Request method failure captured: Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca HTTP/1.1 Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUyF5bmoe0ToHpfa6r2aHci0KMoDtkarWFLEl6TiOMdTqhzQllL7HLXl6Sav8Ro6O_LoxXEPyvyqxDbttWJMbcym2Mu6PF0rHKRvKedD5k_IQOIk7xbVIhJ8RZ0A921sIMNUooz7YsaYIXmjOpDLPmel_ZzTgf8fFsvF1JHBJI1KlI Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:25.148388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/fb8207ad9abf449b99382a2586d4588a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_fb8207ad9abf449b99382a2586d4588a", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: fb8207ad9abf449b99382a2586d4588a Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1273608621 Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 39543aedd1834f68a9d0a4ef174822c2 Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeNegativeTest-1273608621-project Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.150082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '283eb4f3-2765-48cc-9bee-2178c185deca'} Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:25.150885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. Oct 12 12:45:25.152049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:25.153135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] Returning 404 to user: Instance 283eb4f3-2765-48cc-9bee-2178c185deca could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:25.153135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-212871c6-5944-4e81-8c78-7b85512553dc tempest-AttachVolumeNegativeTest-1273608621 tempest-AttachVolumeNegativeTest-1273608621-project] 10.222.0.44 "GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca" status: 404 len: 111 microversion: 2.1 time: 0.030351 Oct 12 12:45:25.153135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 452/925] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:25 2022] GET /compute/v2.1/servers/283eb4f3-2765-48cc-9bee-2178c185deca => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:30.888128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d0c46cd7-02a8-4b8a-bb9b-d8cc0b0eba53 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Action: 'create', calling method: .version_select at 0x7f9808bab670>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1640311620", "metadata": {"Type": "work"}}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d0c46cd7-02a8-4b8a-bb9b-d8cc0b0eba53 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 122 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:30.899892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1640311620", "metadata": {"Type": "work"}}} Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: Oct 12 12:45:30.901545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1640311620', 'metadata': {'Type': 'work'}}}} Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise error Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi '#$%' Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:30.903861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 12:45:30.905502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 12:45:30.906861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Oct 12 12:45:30.906861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.906861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d0c46cd7-02a8-4b8a-bb9b-d8cc0b0eba53 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:30.906861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d0c46cd7-02a8-4b8a-bb9b-d8cc0b0eba53 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.133719 Oct 12 12:45:30.906861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 474/926] 10.222.0.44 () {60 vars in 1156 bytes} [Wed Oct 12 12:45:30 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 135 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:30.911107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0da832fc-aaec-4160-b1b3-3b35cb9afbe6 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Action: 'create', calling method: .version_select at 0x7f98067f8b80>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1177835295", "metadata": {"Type": "work"}}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0da832fc-aaec-4160-b1b3-3b35cb9afbe6 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 120 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:30.916728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1177835295", "metadata": {"Type": "work"}}} Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:45:30.920776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1177835295', 'metadata': {'Type': 'work'}}}} Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise error Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi '0' Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:30.921615 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 12:45:30.923108 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 12:45:30.924885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Oct 12 12:45:30.924885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.924885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0da832fc-aaec-4160-b1b3-3b35cb9afbe6 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:30.924885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0da832fc-aaec-4160-b1b3-3b35cb9afbe6 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010581 Oct 12 12:45:30.924885 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 453/927] 10.222.0.44 () {60 vars in 1156 bytes} [Wed Oct 12 12:45:30 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:30.929350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7e8b5f0a-23e5-467c-bd36-ec75dc198831 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Action: 'create', calling method: .version_select at 0x7f9805464ca0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-106392140", "metadata": {"Type": "work"}}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7e8b5f0a-23e5-467c-bd36-ec75dc198831 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 118 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:30.934133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-106392140", "metadata": {"Type": "work"}}} Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: Oct 12 12:45:30.935946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-106392140', 'metadata': {'Type': 'work'}}}} Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise error Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi On instance['volume']: Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi '' Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:30.937092 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Oct 12 12:45:30.942959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Oct 12 12:45:30.944091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Oct 12 12:45:30.944091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.944091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7e8b5f0a-23e5-467c-bd36-ec75dc198831 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:30.944091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7e8b5f0a-23e5-467c-bd36-ec75dc198831 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.011534 Oct 12 12:45:30.944091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 475/928] 10.222.0.44 () {60 vars in 1156 bytes} [Wed Oct 12 12:45:30 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 14 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:30.950868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-08c595ba-25b4-4597-9f7e-ec63cf862d7a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Calling method '.version_select at 0x7f98053e6dc0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:30.983346 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-08c595ba-25b4-4597-9f7e-ec63cf862d7a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] HTTP exception thrown: Volume tempest-invalid-362853782 could not be found. Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-08c595ba-25b4-4597-9f7e-ec63cf862d7a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-362853782 HTTP/1.1 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:30.985276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume tempest-invalid-362853782 could not be found. Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'tempest-invalid-362853782'} Oct 12 12:45:30.986568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-362853782 could not be found. (HTTP 404) (Request-ID: req-febccc5f-4b63-4908-8b67-2e50a6209d81) Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.987326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:45:30.989859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-362853782 could not be found. Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:30.991834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-362853782 could not be found. Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-362853782 could not be found. Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-08c595ba-25b4-4597-9f7e-ec63cf862d7a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 404 to user: Volume tempest-invalid-362853782 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-08c595ba-25b4-4597-9f7e-ec63cf862d7a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/tempest-invalid-362853782" status: 404 len: 98 microversion: 2.1 time: 0.040364 Oct 12 12:45:30.993547 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 454/929] 10.222.0.44 () {58 vars in 1215 bytes} [Wed Oct 12 12:45:30 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-362853782 => generated 98 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Oct 12 12:45:30.997779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-24e6c982-b1a6-4eb1-b1a6-e7d43f252aba tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003655 Oct 12 12:45:30.998312 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 476/930] 10.222.0.44 () {58 vars in 1140 bytes} [Wed Oct 12 12:45:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 12:45:31.008360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4a4a541c-4e7c-45bf-b78d-c8da717ea81a tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003815 Oct 12 12:45:31.008938 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 455/931] 10.222.0.44 () {58 vars in 1137 bytes} [Wed Oct 12 12:45:31 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Oct 12 12:45:31.018446 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8d722b4b-0fd5-463e-861c-c6ee258385b1 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Calling method '.version_select at 0x7f9805416280>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:31.047439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-8d722b4b-0fd5-463e-861c-c6ee258385b1 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] HTTP exception thrown: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8d722b4b-0fd5-463e-861c-c6ee258385b1 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/os-volumes/769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed HTTP/1.1 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:31.050614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed'} Oct 12 12:45:31.052524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. (HTTP 404) (Request-ID: req-5e0e21a4-2f8e-4de9-a83b-b1e3194964e2) Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.053414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self._delete(loc) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Oct 12 12:45:31.058870 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Oct 12 12:45:31.060408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8d722b4b-0fd5-463e-861c-c6ee258385b1 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 404 to user: Volume 769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8d722b4b-0fd5-463e-861c-c6ee258385b1 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "DELETE /compute/v2.1/os-volumes/769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed" status: 404 len: 109 microversion: 2.1 time: 0.037868 Oct 12 12:45:31.061851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 477/932] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:45:31 2022] DELETE /compute/v2.1/os-volumes/769c8bae-7aa0-4e7e-975b-ae2ee1c6eeed => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:31.063263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2ef436aa-8ef5-40dd-8cef-bc7e03d9cb76 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Calling method '.version_select at 0x7f980523fa60>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:31.093420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-2ef436aa-8ef5-40dd-8cef-bc7e03d9cb76 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] HTTP exception thrown: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2ef436aa-8ef5-40dd-8cef-bc7e03d9cb76 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Request method failure captured: Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/os-volumes/69766a78-22d3-437a-9276-e777c91d9cba HTTP/1.1 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrbqiiq6_aWwmEB13c_J3JpQtOi_jgiAJ-Jdn0CVQCTQdksFSih0t0fqKb2UjQbNm71lSEirqaqKyEBwNsr81GGpWyjYTPD_yNxTkCrUTXlBbTEe7IpIau0uLBTwqRozfpN0YoAVNGWCiaFyjnPhlx_eeECbs48LuGUw-fb-lXDXl64 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:31.095455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7f1531c48a844620bdbb4c6de446071e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7f1531c48a844620bdbb4c6de446071e", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 7f1531c48a844620bdbb4c6de446071e Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesNegativeTest-2114094130 Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 3f701505e4d24954a01dc8252944320c Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesNegativeTest-2114094130-project Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '69766a78-22d3-437a-9276-e777c91d9cba'} Oct 12 12:45:31.096988 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. (HTTP 404) (Request-ID: req-9da6a407-fc10-481e-ac6c-aa2d2ed6b35f) Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.097791 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi item = cinderclient( Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Oct 12 12:45:31.099239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Oct 12 12:45:31.100777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2ef436aa-8ef5-40dd-8cef-bc7e03d9cb76 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] Returning 404 to user: Volume 69766a78-22d3-437a-9276-e777c91d9cba could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2ef436aa-8ef5-40dd-8cef-bc7e03d9cb76 tempest-VolumesNegativeTest-2114094130 tempest-VolumesNegativeTest-2114094130-project] 10.222.0.44 "GET /compute/v2.1/os-volumes/69766a78-22d3-437a-9276-e777c91d9cba" status: 404 len: 109 microversion: 2.1 time: 0.038963 Oct 12 12:45:31.102516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 456/933] 10.222.0.44 () {58 vars in 1245 bytes} [Wed Oct 12 12:45:31 2022] GET /compute/v2.1/os-volumes/69766a78-22d3-437a-9276-e777c91d9cba => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:37.984029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=23 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:37.987669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=52 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:37.991040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:37.993186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:37.999538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.000100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.000981 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.001749 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.002321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.002822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.033274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b612dd3d-7920-4489-a7ca-bca3add4975e tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050398 Oct 12 12:45:38.034467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 478/934] 10.222.0.44 () {60 vars in 1343 bytes} [Wed Oct 12 12:45:37 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:38.098198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=16,nova_api:DELETE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:38.098934 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=48,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:45:38.103520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:38.104055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:38.110407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.110888 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.111319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.112085 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.112529 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.113132 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.139683 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:45:38.419553 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c344e03d-860f-4c08-bd65-863a6cfe5b40 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 204 len: 0 microversion: 2.20 time: 0.322498 Oct 12 12:45:38.420329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 457/935] 10.222.0.44 () {60 vars in 1280 bytes} [Wed Oct 12 12:45:38 2022] DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 12:45:38.430273 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:38.430963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:38.437374 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.438579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.439085 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.441519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:38.442485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:38.442923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:38.594138 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:38.602857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:38.604463 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:38.605617 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2434b704-d44f-45da-844b-dc41f47ba66d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.181086 Oct 12 12:45:38.606220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 479/936] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:38 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:39.636294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:39.637005 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:39.646698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:39.669619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:39.669619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:39.669619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:39.669619 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:39.669983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:39.807781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:39.815686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:39.817122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:39.818331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-aab01eb3-60d3-4e7b-8761-711f46e63620 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1725 microversion: 2.20 time: 0.189599 Oct 12 12:45:39.818879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 458/937] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:39 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1725 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:40.844410 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:40.845215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:40.853300 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:40.854349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:40.855989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:40.858212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:40.860441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:40.862061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:40.921115 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5aa1837-38c8-4935-9019-b77ddab6186b", "name": "network-vif-deleted", "tag": "e6175cce-77f0-4350-b89c-5f74cd77b5b2"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:40.958145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:40.958645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:40.959089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:40.974479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] Creating event network-vif-deleted:e6175cce-77f0-4350-b89c-5f74cd77b5b2 for instance e5aa1837-38c8-4935-9019-b77ddab6186b on hv-cinder-81268 Oct 12 12:45:40.979751 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-d2fa58bc-9eb4-4bee-97b8-75f6bce75ff8 req-65c73854-93ed-4244-a386-9fbcbe7f50d5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062192 Oct 12 12:45:40.980744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 459/938] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:45:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:40.990313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:41.008890 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:41.011862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:41.013476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-06d238d1-0636-4a4e-b713-3f85270ab5d4 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1657 microversion: 2.20 time: 0.173043 Oct 12 12:45:41.015760 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 480/939] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:40 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1657 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:42.048855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:42.050302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:42.057894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:42.058415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:42.058856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:42.066387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:42.066387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:42.066387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:42.105179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:42.105671 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:42.106210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:42.106659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lazy-loading 'fault' on Instance uuid e5aa1837-38c8-4935-9019-b77ddab6186b {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:45:42.159413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:42.168354 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:42.169862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'df8da1fe608d4dd6acb6b7298ca56d45', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c056ad05ef9843688f08b7e9f25e1138', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:42.171043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a82913ad-69e3-4fcc-8355-ca1dd47ef146 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 200 len: 1372 microversion: 2.20 time: 0.129632 Oct 12 12:45:42.171601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 460/940] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:42 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 1372 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Oct 12 12:45:43.196234 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:43.196852 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:43.205407 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:43.206749 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:43.207193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:43.208007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:43.209246 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:43.209874 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:43.227035 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b HTTP/1.1 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:43.228834 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:43.230498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'e5aa1837-38c8-4935-9019-b77ddab6186b'} Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:43.231418 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:43.232929 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:43.234266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:43.234266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2ebbfa2a-2a22-43f6-b3d8-4a116ad16546 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 404 len: 111 microversion: 2.20 time: 0.038369 Oct 12 12:45:43.234266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 481/941] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:43 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:43.239918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2d7e7489-190e-479d-8e1b-448d17c5b735 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '.version_select at 0x7f98053884c0>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:43.310955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2d7e7489-190e-479d-8e1b-448d17c5b735 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078181031" status: 204 len: 0 microversion: 2.20 time: 0.074720 Oct 12 12:45:43.311539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 461/942] 10.222.0.44 () {60 vars in 1262 bytes} [Wed Oct 12 12:45:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1078181031 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Oct 12 12:45:45.496062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:45.496624 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:45.508365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:45.508365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:45.508365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:45.508365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:45.509072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:45.509072 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:45.527627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b HTTP/1.1 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:45.529261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.530941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'e5aa1837-38c8-4935-9019-b77ddab6186b'} Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:45.531930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.533310 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.537350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:45.537350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d7a36adb-7b6f-4783-8fc1-6b8e544cd741 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 404 len: 111 microversion: 2.20 time: 0.038476 Oct 12 12:45:45.537350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 482/943] 10.222.0.44 () {60 vars in 1280 bytes} [Wed Oct 12 12:45:45 2022] DELETE /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:45.543693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:45.544317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: e5aa1837-38c8-4935-9019-b77ddab6186b] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:45.550859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:45.551340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:45.551766 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:45.552451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:45.552895 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:45.553313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b HTTP/1.1 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:45.569783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.571720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'e5aa1837-38c8-4935-9019-b77ddab6186b'} Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:45.572943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. Oct 12 12:45:45.574169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:45.576076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance e5aa1837-38c8-4935-9019-b77ddab6186b could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:45.576076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-bb7e8fa8-4fd5-475d-b1b2-726a85e3914d tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b" status: 404 len: 111 microversion: 2.20 time: 0.032137 Oct 12 12:45:45.576076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 462/944] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:45 2022] GET /compute/v2.1/servers/e5aa1837-38c8-4935-9019-b77ddab6186b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:47.015883 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:47.016383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:47.023643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:47.024807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:47.025384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:47.026247 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:47.026883 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:47.027405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:47.042184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 HTTP/1.1 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:47.044747 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.046524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2'} Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:47.047534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.048784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.057885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:47.057885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7d4fb40d-b0f8-404f-8c18-a154a7606c58 tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 404 len: 111 microversion: 2.20 time: 0.033932 Oct 12 12:45:47.057885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 483/945] 10.222.0.44 () {60 vars in 1280 bytes} [Wed Oct 12 12:45:47 2022] DELETE /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:47.058670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:47.058670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] [instance: 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:47.076870 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:47.077467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:47.078030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:47.078785 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:47.079431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:47.080028 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:47.095116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] HTTP exception thrown: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Request method failure captured: Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 HTTP/1.1 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrUzLTvHoz5aPd5h53nH-3IdFnJjFKjXubc6QP8taynaX0SHxnjuw3_bT_S-p2Q2hVqstHR2fyDyHI4c8nWU9lAwWi5_Ibi-kEp9Ki8QJgu-WR64F4-tVe35dY98K1nkGznmq2UnJ9L1Gp88KPa-Lu6GZqvAmjHcWhziQ5EuCuqYTc4 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Openstack-Nova-Api-Version: 2.20 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:45:47.097001 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/c056ad05ef9843688f08b7e9f25e1138"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_c056ad05ef9843688f08b7e9f25e1138", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: c056ad05ef9843688f08b7e9f25e1138 Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-167167680 Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: df8da1fe608d4dd6acb6b7298ca56d45 Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeShelveTestJSON-167167680-project Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.098701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2'} Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:47.102940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. Oct 12 12:45:47.104930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:45:47.106226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] Returning 404 to user: Instance 5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:47.106226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c93d40a7-6b27-4227-af1b-8028d50219dd tempest-AttachVolumeShelveTestJSON-167167680 tempest-AttachVolumeShelveTestJSON-167167680-project] 10.222.0.44 "GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2" status: 404 len: 111 microversion: 2.20 time: 0.047485 Oct 12 12:45:47.106226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 463/946] 10.222.0.44 () {60 vars in 1277 bytes} [Wed Oct 12 12:45:47 2022] GET /compute/v2.1/servers/5fb9a475-1ea2-4308-bb2b-e8eafd3cf6a2 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Oct 12 12:45:50.477892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:50.478430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:50.485003 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:50.488603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:50.493204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:50.493676 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:50.494586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:50.495053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:50.495479 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:50.506679 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:50.507462 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:50.508270 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:50.531591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] Creating event network-changed:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:45:50.539221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-f90241a0-558b-40e1-910e-338a04ef3732 req-feeb7537-a861-456c-8eb7-d6e929d0e01b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058056 Oct 12 12:45:50.540406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 464/947] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:45:50.548348 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:45:50.951303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-36a9ff3b-61a9-42ef-92ec-b2a2988fa0a6 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 204 len: 0 microversion: 2.1 time: 0.477431 Oct 12 12:45:50.961007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 484/948] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:45:50 2022] DELETE /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 0 bytes in 482 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:45:50.968257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:50.968257 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:50.981325 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:50.985356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:50.985814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:50.991906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:50.994351 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:50.997400 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:51.206048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:51.214463 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9846a65f-b849-4d09-9012-0a9b19263c21 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.254864 Oct 12 12:45:51.215218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 465/949] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:50 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:52.239243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:52.239981 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:52.246412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:52.246898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:52.247341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:52.248032 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:52.248482 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:52.248901 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:52.381737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:52.390124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-07ce0b9a-ccbb-477d-ae4e-efe3775e0318 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.155373 Oct 12 12:45:52.390686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 485/950] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:52 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:53.412796 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:53.413407 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:53.420364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:53.420840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:53.421269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:53.421981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:53.422435 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:53.422945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:53.556081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:53.563798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5c0174f7-31b8-44a7-8d62-09ab606e56a9 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.155033 Oct 12 12:45:53.564360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 466/951] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:53 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:54.588420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:54.589704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:54.595725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:54.596203 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:54.596628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:54.597318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:54.597795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:54.598426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:54.830888 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:54.840762 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-33cb5129-c8ac-471c-b87d-e45a7d10b2c8 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1567 microversion: 2.1 time: 0.257000 Oct 12 12:45:54.858813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 486/952] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:54 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1567 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:55.865583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:55.866247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:55.884162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:55.885080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:55.885731 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:55.886450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:55.886868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:55.887401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:55.968717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6222337e-587d-4200-bcb3-264fc5b2395d", "name": "network-vif-deleted", "tag": "32b9fcb7-660c-471b-abbd-960e2c87b57b"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:55.988017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:55.988695 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:55.989140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:55.990234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:56.002701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ad2cb64b-f5ef-42ba-9f51-587e464f460f tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1382 microversion: 2.1 time: 0.141260 Oct 12 12:45:56.004922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 467/953] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:55 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1382 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:56.021381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] Creating event network-vif-deleted:32b9fcb7-660c-471b-abbd-960e2c87b57b for instance 6222337e-587d-4200-bcb3-264fc5b2395d on hv-cinder-81268 Oct 12 12:45:56.029739 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-4bbd2285-3af8-49b7-8a01-c0e6a1b6a4af req-3ffbfe3a-6897-460b-a115-486da8ecffbd service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069073 Oct 12 12:45:56.031079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 487/954] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:45:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:45:57.029141 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:57.030157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:57.039131 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:57.040555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:57.041253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:57.042252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:57.042930 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:57.043568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:57.128846 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:57.138869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e789e0cc-91ae-4824-93eb-456318eed89b tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1219 microversion: 2.1 time: 0.115644 Oct 12 12:45:57.143086 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 468/955] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:57 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1219 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:58.166792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:58.168152 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:58.177730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:58.177960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:58.178381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:58.179088 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:58.179545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:58.182136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:58.238042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:58.238837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:58.239517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:58.240027 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lazy-loading 'fault' on Instance uuid 6222337e-587d-4200-bcb3-264fc5b2395d {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:45:58.284141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b0a7f349d8ba4bea9a609e7cf881b1b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b15d78e196664c1aa41be6c5afe4238b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:45:58.293539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-01e72353-824c-4cdb-a663-fdbdaa895761 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 200 len: 1178 microversion: 2.1 time: 0.132557 Oct 12 12:45:58.301964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 488/956] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:58 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 1178 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:45:59.106928 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-dcbaabd5-8091-4a53-9549-874e6d9fc173 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: .version_select at 0x7f980523fb80>, body: {"keypair": {"name": "tempest-keypair-1073236850", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNdLgUbgmwVwpbvLugoO0Ij7KCgb2dgyPhr0qhoATrftbGzml9AyZOncquF3F/7r/GXZ4cBYL3KySir2WfUNMH/dxlw/D0sTQcyqWbPeaviY/7T2mo0f5Lhmo2Kmr4rjvA=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:45:59.125070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-dcbaabd5-8091-4a53-9549-874e6d9fc173 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for project 3ebab900aef740b68af799c4695e6e5f. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:45:59.129361 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-dcbaabd5-8091-4a53-9549-874e6d9fc173 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for user f84e6adb1a0e4d709b2962c9793346dc and project 3ebab900aef740b68af799c4695e6e5f. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:45:59.210324 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-dcbaabd5-8091-4a53-9549-874e6d9fc173 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.236358 Oct 12 12:45:59.211299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 469/957] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:45:58 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:45:59.322133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:59.322756 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] [instance: 6222337e-587d-4200-bcb3-264fc5b2395d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:45:59.330432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:59.331207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:59.331835 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:59.332727 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:45:59.333344 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:45:59.339003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:45:59.351577 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] HTTP exception thrown: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Request method failure captured: Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d HTTP/1.1 Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrWg39Tr1mAe5yqx4rKcMuuvalo_2TeEOiiprgIl5LzuLa52skOTuBCOmZcvxQtmu0iPZQwLcSxEF7p6F38Z0Pbt8LQxs-jJthd1i2SrVyY9BxmoJCbTu24vu-s8JK-PNhO4PlZmIAprBDLfUlXiwV7lDDj1b3C8U2yBAeWT4BRn6YQ Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: b15d78e196664c1aa41be6c5afe4238b Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-TestShelveInstance-1187232216 Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:45:59.353677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b15d78e196664c1aa41be6c5afe4238b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/b15d78e196664c1aa41be6c5afe4238b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/b15d78e196664c1aa41be6c5afe4238b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_b15d78e196664c1aa41be6c5afe4238b", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-TestShelveInstance-1187232216 Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: b15d78e196664c1aa41be6c5afe4238b Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-TestShelveInstance-1187232216 Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-TestShelveInstance-1187232216-project Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: b0a7f349d8ba4bea9a609e7cf881b1b9 Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-TestShelveInstance-1187232216-project Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. Oct 12 12:45:59.355679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '6222337e-587d-4200-bcb3-264fc5b2395d'} Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:45:59.356530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. Oct 12 12:45:59.357798 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:45:59.361229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Returning 404 to user: Instance 6222337e-587d-4200-bcb3-264fc5b2395d could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:45:59.362339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3c3865a4-931a-4b2a-bfc3-cc0ef7f97200 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d" status: 404 len: 111 microversion: 2.1 time: 0.045624 Oct 12 12:45:59.365207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 489/958] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:45:59 2022] GET /compute/v2.1/servers/6222337e-587d-4200-bcb3-264fc5b2395d => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:45:59.642258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-88c27476-ae7a-4079-9a7a-d3c5e0e904d0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] Calling method '.version_select at 0x7f980528ee50>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:45:59.731637 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-88c27476-ae7a-4079-9a7a-d3c5e0e904d0 tempest-TestShelveInstance-1187232216 tempest-TestShelveInstance-1187232216-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1512064642" status: 202 len: 0 microversion: 2.1 time: 0.093234 Oct 12 12:45:59.732755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 470/959] 10.222.0.44 () {58 vars in 1254 bytes} [Wed Oct 12 12:45:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1512064642 => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:46:01.990461 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2080378703", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3056a6cc-68c2-4250-940c-4ab601619b85"}], "security_groups": [{"name": "tempest-securitygroup--1655037321"}], "key_name": "tempest-keypair-1073236850", "user_data": "}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:02.175903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] validate_networks() for [('3056a6cc-68c2-4250-940c-4ab601619b85', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:46:02.998573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:46:02.999174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:46:02.999454 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:46:02.999858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:46:03.000256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:46:03.010772 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:03.012975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:03.012975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:03.012975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:03.013631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:03.014120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:03.037372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for project 3ebab900aef740b68af799c4695e6e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:46:03.041724 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for user f84e6adb1a0e4d709b2962c9793346dc and project 3ebab900aef740b68af799c4695e6e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:46:03.053433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:46:03.056314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:46:03.204228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1b85e40e-1835-4a2c-8805-b26f5a06856b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.219289 Oct 12 12:46:03.204974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 490/960] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:46:01 2022] POST /compute/v2.1/servers => generated 402 bytes in 1221 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:46:03.216707 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cecba642-0b08-4ba8-bbf6-7b32dd4e5a7d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:03.217229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cecba642-0b08-4ba8-bbf6-7b32dd4e5a7d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:03.293969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cecba642-0b08-4ba8-bbf6-7b32dd4e5a7d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:03.302760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cecba642-0b08-4ba8-bbf6-7b32dd4e5a7d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1238 microversion: 2.1 time: 0.090337 Oct 12 12:46:03.304107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 471/961] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:03 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1238 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:04.329349 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-18fd0b94-7180-4aee-b3e0-87e07ebbf450 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:04.329975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-18fd0b94-7180-4aee-b3e0-87e07ebbf450 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:04.399514 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-18fd0b94-7180-4aee-b3e0-87e07ebbf450 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:04.406696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-18fd0b94-7180-4aee-b3e0-87e07ebbf450 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1238 microversion: 2.1 time: 0.082056 Oct 12 12:46:04.407631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 491/962] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:04 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1238 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:05.430638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:05.431269 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:05.438526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:05.439016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:05.439451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:05.440147 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:05.440775 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:05.441200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:05.524097 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:05.532602 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-884797c1-9bb3-4cdf-8cd0-09f256bee71f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1242 microversion: 2.1 time: 0.105818 Oct 12 12:46:05.533180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 472/963] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:05 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1242 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:06.557988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:06.559278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:06.567080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:06.567930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:06.568640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:06.570154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:06.570819 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:06.571495 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:06.641541 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:06.650943 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7d3b9977-da75-4797-b747-42d34ea955f4 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1242 microversion: 2.1 time: 0.098023 Oct 12 12:46:06.651527 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 492/964] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:06 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:07.674165 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:07.675452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:07.685232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:07.688868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:07.688868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:07.688868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:07.688868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:07.689207 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:07.769330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:07.777549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6f927400-d96d-41a3-b430-04f73493808c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1290 microversion: 2.1 time: 0.107547 Oct 12 12:46:07.778367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 473/965] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:07 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1290 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:08.800847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:08.801637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:08.804285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:08.810229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:08.810651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:08.811104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:08.811994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:08.812455 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:08.812897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:08.817244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:08.877801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:08.887145 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e7d4852e-bb53-45af-83f1-03bc4118df51 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1296 microversion: 2.1 time: 0.090076 Oct 12 12:46:08.888026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 493/966] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:08 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1296 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:09.916583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:09.916583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:09.916583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=55,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:09.920473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:09.921162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:09.921696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:09.922645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:09.923170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:09.923667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:10.018365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7eff460-0340-44df-bc50-1b3d50f3aa9d", "tag": "d3627907-d8ad-4f99-b54e-5162888fde02"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:10.031106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:10.031590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:10.033218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:10.044960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] Creating event network-changed:d3627907-d8ad-4f99-b54e-5162888fde02 for instance f7eff460-0340-44df-bc50-1b3d50f3aa9d on hv-cinder-81268 Oct 12 12:46:10.049871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-84b53ebe-9e43-4e7a-a444-74644ca68d38 req-33f42f90-afed-4b16-a126-8439dfb16eaf service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035395 Oct 12 12:46:10.050530 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 494/967] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:46:10.118395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:10.138190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7140b184-8583-46d8-9314-6fca49154497 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.230495 Oct 12 12:46:10.138774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 474/968] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:09 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:46:11.163426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:11.164118 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:11.171551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:11.172129 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:11.177767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:11.177767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:11.177767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:11.177767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:11.301259 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:11.309093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-baf0314f-0d42-46fa-a5b3-96522dce3e15 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.150985 Oct 12 12:46:11.309842 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 495/969] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:11 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:12.332286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:12.332966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:12.339945 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:12.340421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:12.340946 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:12.341517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:12.341993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:12.342413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:12.346509 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:12.471632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:12.479720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-452c28c1-39e7-489d-b41d-e041dc972def tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.151334 Oct 12 12:46:12.483667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 475/970] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:12 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:13.503211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:13.503813 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:13.506239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:13.511569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:13.512053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:13.512483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:13.513167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:13.513611 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:13.514056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:13.650059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:13.650059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-199da74e-09a7-49ad-a02b-ca0080ee70e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.148621 Oct 12 12:46:13.650059 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 496/971] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:13 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:14.670790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:14.671399 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:14.673334 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:14.678948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:14.679429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:14.685722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:14.685722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:14.685722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:14.685722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:14.811067 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:14.818732 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ca6d6d90-17cf-4a65-ba24-729ab1d15f2b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.152530 Oct 12 12:46:14.819263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 476/972] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:14 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:15.840933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:15.841732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:15.844810 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=8 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:15.848737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:15.849219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:15.849997 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:15.850387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:15.850840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:15.851261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:15.991922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:16.000391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d58e637a-0a0c-4097-a069-d92d5e1daf91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.163399 Oct 12 12:46:16.000967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 497/973] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:15 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:17.023329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:17.023940 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:17.031479 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:17.031958 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:17.032387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:17.033070 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:17.033519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:17.033957 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:17.161624 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:17.169305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a78ed0a3-6b40-40ff-bf2b-9782c0442b03 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.149884 Oct 12 12:46:17.169872 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 477/974] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:17 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:17.360957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eff460-0340-44df-bc50-1b3d50f3aa9d", "name": "network-vif-plugged", "status": "completed", "tag": "d3627907-d8ad-4f99-b54e-5162888fde02"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:17.371804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:17.373851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:17.373851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:17.383662 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] Creating event network-vif-plugged:d3627907-d8ad-4f99-b54e-5162888fde02 for instance f7eff460-0340-44df-bc50-1b3d50f3aa9d on hv-cinder-81268 Oct 12 12:46:17.389122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-06b83114-082b-432a-b1b2-e70bb6a11433 req-5aca7eff-5846-4562-98b8-10f90f42f5c9 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031951 Oct 12 12:46:17.389691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 498/975] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:46:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:46:18.192891 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:18.193497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:18.200738 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:18.201223 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:18.201669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:18.202379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:18.202834 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:18.203393 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:18.331936 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:18.341195 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c0b5f134-b00f-474e-bdc6-482842f9c9fd tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1364 microversion: 2.1 time: 0.152192 Oct 12 12:46:18.341754 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 478/976] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:18 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:19.363946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:19.364827 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:19.371884 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:19.372439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:19.373055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:19.373917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:19.374410 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:19.374837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:19.546006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:19.553748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a66d0c84-0eae-412d-8e49-b813ff8552b2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1550 microversion: 2.1 time: 0.194463 Oct 12 12:46:19.554350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 499/977] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:19 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1550 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:46:19.576947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:19.577450 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:19.583956 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:19.584439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:19.584874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:19.585566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:19.587669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:19.587669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:19.662095 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3f686208-00f0-437e-9ec9-07282cc9be46 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088921 Oct 12 12:46:19.662695 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 479/978] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:46:19 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:46:21.030091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7eff460-0340-44df-bc50-1b3d50f3aa9d", "tag": "d3627907-d8ad-4f99-b54e-5162888fde02"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:21.042036 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:21.042575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:21.042945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:21.054083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] Creating event network-changed:d3627907-d8ad-4f99-b54e-5162888fde02 for instance f7eff460-0340-44df-bc50-1b3d50f3aa9d on hv-cinder-81268 Oct 12 12:46:21.059538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-b37925b6-4d7f-4205-97c3-f273305ad68c req-bcea2ed8-7152-4763-8679-b1851bb73a11 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033424 Oct 12 12:46:21.064324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 500/979] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:46:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:46:47.577133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=11 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:47.577894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=27 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:47.582381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:47.582880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:47.588884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:47.589371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:47.592280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:47.592280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:47.592280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:47.592280 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:47.616968 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:46:47.878648 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-628faf67-1246-4da0-94b1-44de4ba88ac9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 204 len: 0 microversion: 2.1 time: 0.302999 Oct 12 12:46:47.879180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 480/980] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:46:47 2022] DELETE /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:46:47.885227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=15 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:47.886021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=35 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:46:47.886778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:46:47.886917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Wed Oct 12 12:46:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 (ip 10.222.0.44) !!! Oct 12 12:46:47.893603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:47.894963 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:47.902197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:47.902679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:47.903114 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:47.903804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:47.904267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:47.904714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:48.037733 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:48.045430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-22dd3bca-bc4a-485e-b9f0-1e09d7a9f6ff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1576 microversion: 2.1 time: 0.161914 Oct 12 12:46:48.046016 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 501/981] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:47 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:49.070083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:49.070768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:49.077743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:49.078248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:49.078677 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:49.079376 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:49.079827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:49.080246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:49.210100 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:49.218692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-67fa0c2a-c199-438c-a303-2dd445f606d8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1576 microversion: 2.1 time: 0.152996 Oct 12 12:46:49.219258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 481/982] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:49 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:50.240642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:50.241211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:50.247585 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:50.248555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:50.248986 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:50.249669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:50.250154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:50.250579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:50.314675 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:50.322321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-17ce8367-c394-43be-9143-fcfaeeee7cd9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1509 microversion: 2.1 time: 0.085615 Oct 12 12:46:50.322887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 502/983] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:50 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1509 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:50.460410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1", "name": "network-vif-deleted", "tag": "033b8a88-95a3-4f47-bd2f-1ac25dfe152e"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:50.470176 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:50.470653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:50.471076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:50.481856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] Creating event network-vif-deleted:033b8a88-95a3-4f47-bd2f-1ac25dfe152e for instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 on hv-cinder-81268 Oct 12 12:46:50.487145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-1ed45228-7c5c-4dc8-93a9-d6a0303fba74 req-dcb1e13e-6cd2-44ca-aff5-b50d1387298a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031549 Oct 12 12:46:50.489185 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 482/984] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:46:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:46:51.346702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:51.350403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:51.353927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:51.354503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:51.355048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:51.355615 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:51.356066 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:51.356485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:51.388116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:51.389132 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:51.389565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:51.390051 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lazy-loading 'fault' on Instance uuid ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:46:51.434989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:51.443728 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cc89605b-5d7c-401e-b00f-ca0f782140ae tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 200 len: 1229 microversion: 2.1 time: 0.101488 Oct 12 12:46:51.444314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 503/985] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:51 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 1229 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:52.468966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:52.469664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:52.475793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:52.476271 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:52.476702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:52.477385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:52.477835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:52.478305 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:52.491847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] HTTP exception thrown: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Request method failure captured: Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 HTTP/1.1 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrZ61wkDZuYWxjwsu4kNx-jd1YJVHIXjC5s91oDfRcn7WbRlEwkRnH9w5wkE20cumblp97B21XV0rr1IoZyW8nSNvM89hPbRBOSQt7C21XAslnMC7q2XOQtsZfGLssPRNkqiQGL3DnaobDqg8qMFsSMRk0SluDe9tRdUxNs5BXjj0GY Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:46:52.493464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_00c9aab9a0264449ac51194afd4cb6a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 205b19ccb80a45fd8ed36abd2c4c32c3 Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:46:52.494978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1'} Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:46:52.495874 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:46:52.497425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:46:52.498855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Returning 404 to user: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:46:52.498855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cd54d36e-98a2-4c4f-8f52-49735dedec85 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 404 len: 111 microversion: 2.1 time: 0.031119 Oct 12 12:46:52.498855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 483/986] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:52 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:46:52.593430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-867762038", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1979552841", "security_groups": [{"name": "tempest-secgroup-smoke-292163129"}], "block_device_mapping_v2": [{"uuid": "3627ae50-3845-4afc-b4a2-be0bdbda7614", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df10711-3511-48ea-bbdd-b691bad6a273"}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:52.708400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] validate_networks() for [('3df10711-3511-48ea-bbdd-b691bad6a273', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:46:53.066124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:46:53.066546 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:46:53.067021 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:46:53.067428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:46:53.068142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:46:53.077826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:53.078342 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:53.078775 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:53.079509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:53.079964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:53.080389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:53.096881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:46:53.100816 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for user 205b19ccb80a45fd8ed36abd2c4c32c3 and project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:46:53.160551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:46:53.162693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3627ae50-3845-4afc-b4a2-be0bdbda7614',volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:46:53.518716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-27cdfe84-afcc-483c-afd7-215ae7ce9fb7 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.929442 Oct 12 12:46:53.519278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 504/987] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:46:52 2022] POST /compute/v2.1/servers => generated 405 bytes in 931 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Oct 12 12:46:53.538475 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-22400472-d61c-43fd-975a-69010710e4e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:53.539543 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-22400472-d61c-43fd-975a-69010710e4e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:53.596684 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-22400472-d61c-43fd-975a-69010710e4e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:53.603535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-22400472-d61c-43fd-975a-69010710e4e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1094 microversion: 2.1 time: 0.072145 Oct 12 12:46:53.604101 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 484/988] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:53 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:54.627263 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:54.627879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:54.634602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:54.635112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:54.635670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:54.636356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:54.636808 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:54.637228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:54.697229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:54.705619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-24c8f81b-c7f5-419f-ad65-d41f028fbbcf tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1144 microversion: 2.1 time: 0.083156 Oct 12 12:46:54.706218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 505/989] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:54 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:55.727782 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:55.728393 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:55.735182 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:55.735670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:55.736104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:55.736793 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:55.737244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:55.737665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:55.844579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:55.852962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a81b1a32-aba6-4489-88fc-6a85316b501c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1200 microversion: 2.1 time: 0.129220 Oct 12 12:46:55.853512 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 485/990] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:55 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1200 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:56.876606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:56.877552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:56.884452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:56.884946 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:56.885384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:56.886136 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:56.886594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:56.887091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:56.973109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:56.973784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:56.981875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:56.983055 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:56.983710 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:56.984605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:56.985172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:56.985663 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:57.024446 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5409c5b3-f784-42aa-a940-45a57256feac tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/ips" status: 200 len: 145 microversion: 2.1 time: 0.056330 Oct 12 12:46:57.025536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 486/991] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:46:56 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:46:57.044442 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:57.053656 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5da2777b-2c5c-49c7-944f-d959d633bb3d tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1277 microversion: 2.1 time: 0.181077 Oct 12 12:46:57.062236 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 506/992] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:56 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1277 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:57.608996 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c135a91-bcaa-4a50-b122-9b0f4eecb849", "tag": "d6a4edee-58a4-4b3d-9fa8-69ac36926da3"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:57.619030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:57.619507 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:57.619927 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:57.631788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] Creating event network-changed:d6a4edee-58a4-4b3d-9fa8-69ac36926da3 for instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 on hv-cinder-81268 Oct 12 12:46:57.636784 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-4da97ec7-b2b4-4199-8781-443e54eee900 req-ce782364-9e84-4a5b-a911-58a9046ada2f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032361 Oct 12 12:46:57.637382 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 487/993] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:46:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:46:58.083932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:58.084636 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:58.091177 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:58.091663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:58.092278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:58.092981 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:58.093448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:58.093862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:58.228575 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:58.237181 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-073e6584-22ae-482b-8caf-2b6b1b35080c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.157211 Oct 12 12:46:58.237755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 507/994] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:58 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:59.260556 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:46:59.261248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:59.268482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:59.268960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:59.269390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:59.270118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:59.270568 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:59.271063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:59.403411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:46:59.411445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-30e78e3e-ed21-4f54-8f1a-6e402ab2b546 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.155187 Oct 12 12:46:59.412013 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 488/995] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:46:59 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:46:59.799719 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d184131-cd7b-4630-9ee6-67e6e0c6c8e2"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:46:59.802213 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:46:59.808523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:59.809005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:59.809434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:46:59.810153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:46:59.810606 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:46:59.811028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:00.434297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:00.434909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:00.441693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:00.442283 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:00.442714 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:00.443429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:00.443882 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:00.444297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:00.522888 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5b2903de-3680-4be7-9822-5b0d46e99340 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.727580 Oct 12 12:47:00.523493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 508/996] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:46:59 2022] POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments => generated 194 bytes in 729 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:47:00.580477 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:00.588294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a590d763-5c75-42e1-aee1-989d5059f22e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.157855 Oct 12 12:47:00.588853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 489/997] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:00 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:47:01.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:01.613387 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:01.619480 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:01.619960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:01.620394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:01.621078 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:01.621529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:01.621968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:01.751206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:01.759134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6cad87ba-a4f4-4ab9-bbbc-a8a6a9d37e22 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.151714 Oct 12 12:47:01.759702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 509/998] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:01 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:02.781533 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:02.782204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:02.788531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:02.789009 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:02.789439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:02.790145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:02.790591 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:02.791004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:02.920018 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:02.927664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e7784701-cf0d-4e5d-8493-62f5f3767666 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.150007 Oct 12 12:47:02.928226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 490/999] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:02 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:03.951219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:03.951793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:03.954740 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:03.955406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:03.960229 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:03.962271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:03.962271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:03.962271 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:03.962634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:03.962779 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:04.094661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:04.102220 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-98f50a66-3877-4459-9e0e-4164bd140f9a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.155010 Oct 12 12:47:04.102784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 510/1000] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:03 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:05.124623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:05.125233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:05.127175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:05.134981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:05.134981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:05.134981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:05.134981 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:05.135420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:05.135420 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:05.263906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:05.271544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cfe87b5f-5fd0-4894-9691-ec9cdbdd13c4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.150832 Oct 12 12:47:05.272104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 491/1001] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:05 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:06.294483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:06.295093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:06.301913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:06.302426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:06.302857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:06.303545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:06.303993 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:06.304414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:06.432014 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:06.440419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-101b21fc-dd8e-417b-a1d2-e3f5556e2251 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.149830 Oct 12 12:47:06.441003 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 511/1002] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:06 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:07.463026 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:07.463682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:07.470259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:07.470795 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:07.471210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:07.471918 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:07.472377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:07.472805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:07.565109 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c135a91-bcaa-4a50-b122-9b0f4eecb849", "name": "network-vif-plugged", "status": "completed", "tag": "d6a4edee-58a4-4b3d-9fa8-69ac36926da3"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:47:07.570081 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:07.570650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:07.571209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:07.582989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] Creating event network-vif-plugged:d6a4edee-58a4-4b3d-9fa8-69ac36926da3 for instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 on hv-cinder-81268 Oct 12 12:47:07.588074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-4e406a4e-e3a8-4bae-acb5-1c1f0b6dc031 req-69628d01-67f6-464a-9eba-819c6ce44742 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034110 Oct 12 12:47:07.593470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 512/1003] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:47:07.618057 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:07.626458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-22b3826d-080a-4414-b22a-fb8da3cf824c tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.167355 Oct 12 12:47:07.627021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 492/1004] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:07 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:08.055898 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:47:08.062080 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:08.062569 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:08.063006 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:08.124346 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Going to try to stop instance {{(pid=130867) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 12:47:08.320335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-704b379c-3db9-4a8a-bab3-917c27336837 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action" status: 202 len: 0 microversion: 2.1 time: 0.268468 Oct 12 12:47:08.320942 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 513/1005] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:47:08 2022] POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:47:08.329540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:08.330181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:08.336054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:08.336542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:08.336976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:08.337674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:08.338161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:08.338589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:08.466170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:08.475589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4001b2c0-3fd5-4f2b-bbf9-d028514ca761 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.150418 Oct 12 12:47:08.476162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 493/1006] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:08 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:08.650574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:08.651204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:08.657996 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:08.658488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:08.658925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:08.659646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:08.660104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:08.660540 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:08.792957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:08.800850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4267f714-a5d8-455f-9fcc-bac45a3fa3a6 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1265 microversion: 2.1 time: 0.155015 Oct 12 12:47:08.801420 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 514/1007] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:08 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:09.498135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:09.498931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:09.505565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:09.506083 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:09.506515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:09.507196 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:09.507645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:09.508064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:09.637718 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:09.645953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f0236af5-5073-4538-94ae-5c1f645b4ca9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.151732 Oct 12 12:47:09.646523 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 494/1008] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:09 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:09.823818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:09.824426 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:09.831268 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:09.831743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:09.832174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:09.832855 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:09.833302 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:09.833720 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:09.960994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:09.969607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-502a7103-79f8-4bbe-991a-6bd26068fea5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1452 microversion: 2.1 time: 0.149021 Oct 12 12:47:09.970204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 515/1009] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:09 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:09.991705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:09.993064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:09.998457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:09.998947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:10.005215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:10.005215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:10.005215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:10.005215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:10.131279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:10.139019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-56301a55-d079-4202-a5b3-f84ec9397998 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1452 microversion: 2.1 time: 0.151228 Oct 12 12:47:10.139592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 495/1010] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:09 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1452 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:10.668592 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:10.672692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:10.675635 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:10.676116 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:10.676566 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:10.677320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:10.677766 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:10.678208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:10.682487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:10.825976 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:10.836100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f3530f84-d227-4a60-861b-0aff4489ef0d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.171248 Oct 12 12:47:10.836702 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 516/1011] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:10 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:11.860600 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:11.861181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:11.867955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:11.868778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:11.868898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:11.869557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:11.870038 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:11.870461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:12.035873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c135a91-bcaa-4a50-b122-9b0f4eecb849", "tag": "d6a4edee-58a4-4b3d-9fa8-69ac36926da3"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:47:12.037541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:12.046674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:12.047465 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-05eccf35-f063-4a3f-8593-d7c10e26a884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.190172 Oct 12 12:47:12.048026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:12.049545 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:12.049688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 496/1012] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:11 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:12.060341 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] Creating event network-changed:d6a4edee-58a4-4b3d-9fa8-69ac36926da3 for instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 on hv-cinder-81268 Oct 12 12:47:12.065868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-aaa839d2-ab2a-4f35-a174-51792f6aa40e req-b8650595-4930-4a7f-a587-ab39a45f99e5 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034267 Oct 12 12:47:12.070646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 517/1013] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:47:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:47:13.074172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:13.074817 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:13.081778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:13.082300 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:13.082734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:13.083419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:13.083873 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:13.084296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:13.208755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:13.216863 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-79330227-a6dc-45d7-9656-c8704052601d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.146601 Oct 12 12:47:13.217416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 497/1014] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:13 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:14.241288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:14.242045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:14.248838 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:14.249321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:14.249754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:14.250476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:14.250932 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:14.251360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:14.379803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:14.387930 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c9d46028-cfa7-4d91-9692-6edaa0e20e4c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.151284 Oct 12 12:47:14.388499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 518/1015] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:14 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:15.411598 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:15.412208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:15.418673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:15.419161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:15.419638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:15.420331 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:15.420783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:15.421206 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:15.425758 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:15.557022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:15.565468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-93812819-68f6-4fcd-8af4-350a78b528c6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.157841 Oct 12 12:47:15.570139 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 498/1016] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:15 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:16.588704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:16.589350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:16.595730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:16.596210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:16.596642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:16.597323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:16.597777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:16.598231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:16.725839 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:16.733987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1cdae3f6-de9f-4d4e-b062-0c45ff3b9c88 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.149219 Oct 12 12:47:16.735102 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 519/1017] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:16 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:17.757726 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:17.758368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:17.760682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:17.765535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:17.766667 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:17.770112 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:17.770112 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:17.770112 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:17.770112 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:17.895499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:17.903947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7695cdb0-a962-4e45-b61d-6d1a79b41750 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.150456 Oct 12 12:47:17.904510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 499/1018] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:17 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:18.927188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:18.927802 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:18.930252 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=3 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:47:18.934831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:18.935314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:18.935748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:18.936433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:18.936885 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:18.937304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:19.064975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:19.073422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-4460b9cf-5d2b-4445-900f-c74d59a869df tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.150036 Oct 12 12:47:19.074019 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 520/1019] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:18 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:20.097226 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:20.097840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:20.104593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:20.105081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:20.105517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:20.106242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:20.106701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:20.107128 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:20.235735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:20.244071 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-54d96069-f65a-4b82-af15-678af139c97d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.151349 Oct 12 12:47:20.244647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 500/1020] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:20 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:21.267692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:21.268343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:21.274792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:21.275275 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:21.275708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:21.276397 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:21.276847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:21.277272 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:21.403367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:21.411879 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-31e130ee-b7a3-456e-ae8a-fcce3e4b3143 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.148083 Oct 12 12:47:21.412443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 521/1021] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:21 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:22.435500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:22.436107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:22.443133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:22.443613 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:22.444039 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:22.444728 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:22.445177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:22.445595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:22.570890 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:22.578997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-35023169-ee1e-419b-841e-72ecc030f9aa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.147377 Oct 12 12:47:22.579552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 501/1022] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:22 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:23.602075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:23.602687 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:23.609020 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:23.609498 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:23.609947 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:23.610634 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:23.611084 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:23.611504 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:23.739412 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:23.747520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-3c8b200a-3899-4451-9baf-f1d9fc856222 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1724 microversion: 2.1 time: 0.149302 Oct 12 12:47:23.748079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 522/1023] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:23 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:24.771688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:24.772252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:24.778281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:24.778759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:24.779184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:24.779860 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:24.780307 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:24.780724 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:24.911467 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:24.919579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9eae71a8-9204-4593-bd99-6b2bed5666ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1701 microversion: 2.1 time: 0.152483 Oct 12 12:47:24.920137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 502/1024] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:24 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1701 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:47:24.942505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:47:24.948820 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:24.949303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:24.949741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:24.971135 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Going to try to start instance {{(pid=130867) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 12:47:25.133854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ffeb3ffb-ed02-42a8-bc83-7d15fadc6922 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action" status: 202 len: 0 microversion: 2.1 time: 0.195625 Oct 12 12:47:25.134502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 523/1025] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:47:24 2022] POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:47:25.142783 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:25.143448 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:25.149499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:25.150008 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:25.150471 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:25.151159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:25.151693 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:25.152109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:25.279120 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:25.287922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5ac7e5f1-8216-48d4-8315-d1334568cbc0 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1710 microversion: 2.1 time: 0.149057 Oct 12 12:47:25.288694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 503/1026] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:25 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1710 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:26.312748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:26.313445 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:26.320210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:26.320639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:26.321076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:26.321770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:26.322242 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:26.322664 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:26.451491 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:26.459837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d1d9b99b-cd61-49b2-94b4-5f1a49e4e044 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1710 microversion: 2.1 time: 0.151871 Oct 12 12:47:26.460404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 524/1027] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:26 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:47:27.482849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:47:27.483371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:47:27.489833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:27.490350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:27.490790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:27.491484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:47:27.491943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:47:27.492373 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:47:27.619004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:47:27.627585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-049b3df8-20b8-49c7-a6b8-3d8ee1943d0a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1714 microversion: 2.1 time: 0.148723 Oct 12 12:47:27.628408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 504/1028] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:47:27 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1714 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:00.161626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:00.162185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:00.164395 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=9 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:00.165185 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:00.169651 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:00.170173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:00.170603 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:00.171280 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:00.171729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:00.172148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:00.251303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lazy-loading 'services' on Instance uuid f7eff460-0340-44df-bc50-1b3d50f3aa9d {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:48:00.500608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a121f0b2-445b-4dfa-ba87-9d3be8f51bae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments/2d184131-cd7b-4630-9ee6-67e6e0c6c8e2" status: 202 len: 0 microversion: 2.1 time: 0.342729 Oct 12 12:48:00.501222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 525/1029] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:48:00 2022] DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments/2d184131-cd7b-4630-9ee6-67e6e0c6c8e2 => generated 0 bytes in 344 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:48:02.675403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:48:02.677466 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=11 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:02.678256 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=40 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:02.682931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:02.686997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:02.686997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:02.743536 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Going to try to stop instance {{(pid=130866) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Oct 12 12:48:02.932798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6d403911-945d-489e-adc5-1b8122013542 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action" status: 202 len: 0 microversion: 2.1 time: 0.261193 Oct 12 12:48:02.933401 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 505/1030] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:48:02 2022] POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:48:02.943971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:02.944953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:02.950765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:02.951244 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:02.951670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:02.952353 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:02.952807 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:02.953219 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:03.082304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:03.090125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6d93ce73-e6b7-4aae-9b25-7f6f7d6e1124 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.152088 Oct 12 12:48:03.090693 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 526/1031] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:02 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:04.113646 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:04.114379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:04.121029 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:04.121517 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:04.121982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:04.122678 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:04.123135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:04.123560 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:04.431212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:04.438815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-87621e11-48fa-4e4d-932b-915a699d85db tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.329433 Oct 12 12:48:04.439386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 506/1032] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:04 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:05.463103 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:05.463734 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:05.470114 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:05.470594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:05.471025 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:05.471704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:05.472153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:05.473189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:05.653077 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:05.660789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-d766586d-f869-45ae-947f-7dd7d4cd5b7b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.201779 Oct 12 12:48:05.661345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 527/1033] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:05 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:06.683229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:06.683842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:06.690246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:06.691587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:06.691587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:06.691850 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:06.692260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:06.692682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:06.817441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:06.825260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-75992ec7-0bf0-4d91-83e1-dd644b6dbda9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.145908 Oct 12 12:48:06.825829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 507/1034] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:06 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:07.849068 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:07.849668 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:07.856131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:07.856608 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:07.857034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:07.857714 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:07.858194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:07.858614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:07.983262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:07.991660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f3675b7f-2f3f-47a8-8b91-c5cdbb064a96 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.146935 Oct 12 12:48:07.992224 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 528/1035] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:07 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:09.014848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:09.015478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:09.021818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:09.022330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:09.022760 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:09.023441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:09.023887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:09.024304 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:09.155347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:09.163468 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b8457492-03ad-4d17-b164-7d36e8d7b149 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.152421 Oct 12 12:48:09.174159 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 508/1036] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:09 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:10.186394 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:10.187000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:10.193957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:10.194445 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:10.194873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:10.195548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:10.195995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:10.196414 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:10.322886 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:10.330503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b92199ba-fa14-43db-8879-c1998a70bcce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.147954 Oct 12 12:48:10.331061 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 529/1037] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:10 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:11.353997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:11.354576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:11.360835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:11.364814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:11.364814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:11.364814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:11.364814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:11.365260 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:11.731314 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:11.738922 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-00584f64-b278-4ac9-a1ce-3b597d4b974b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.388941 Oct 12 12:48:11.739490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 509/1038] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:11 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:12.762209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:12.762723 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:12.769034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:12.770017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:12.770444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:12.771123 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:12.771597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:12.772013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:12.896861 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:12.904440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-14d143d0-d836-4278-a473-c0fd1fd9ac0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1678 microversion: 2.1 time: 0.146179 Oct 12 12:48:12.905000 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 530/1039] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:12 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:13.928689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:13.929413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:13.935931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:13.936416 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:13.936849 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:13.937540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:13.938022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:13.938482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:14.061618 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:14.069601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e521535a-20a1-4269-9654-49c1ad289753 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1655 microversion: 2.1 time: 0.145413 Oct 12 12:48:14.070221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 510/1040] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:13 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1655 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:14.091800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:48:14.098718 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:14.099204 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:14.099638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:14.121483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Going to try to start instance {{(pid=130867) start /opt/stack/nova/nova/compute/api.py:2785}} Oct 12 12:48:14.344531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-90d5f4e3-cb3d-4700-9bb7-6b8b6d0553fb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action" status: 202 len: 0 microversion: 2.1 time: 0.256337 Oct 12 12:48:14.345189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 531/1041] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:48:14 2022] POST /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/action => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:48:14.354145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:14.354762 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:14.360661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:14.361142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:14.361578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:14.362293 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:14.362747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:14.363190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:14.492900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:14.500942 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4199c04c-98fb-4197-b54c-7e6b8b16ff02 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1664 microversion: 2.1 time: 0.150857 Oct 12 12:48:14.501515 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 511/1042] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:14 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1664 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:15.524980 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:15.525670 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:15.531761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:15.532239 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:15.532669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:15.533351 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:15.533803 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:15.534241 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:15.666625 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:15.673529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-372f8411-edb6-42d9-984f-23386a79806e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1664 microversion: 2.1 time: 0.153286 Oct 12 12:48:15.674124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 532/1043] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:15 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:16.696393 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:16.696960 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:16.703347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:16.703829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:16.704388 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:16.705111 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:16.705562 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:16.706016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:16.832077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:16.839790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-2656555b-0a2c-4033-9690-c29ac3828918 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1668 microversion: 2.1 time: 0.147240 Oct 12 12:48:16.840354 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 512/1044] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:16 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1668 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:48:48.899357 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:48.901593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:48.903933 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=16 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:48.904713 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=55,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:48.909888 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:48.910415 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:48.910850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:48.911532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:48.911987 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:48.912408 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:48.941373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7e781881-3330-42d5-a398-fa34bdf7933f tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046546 Oct 12 12:48:48.942459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 533/1045] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:48:48 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:48:49.005044 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:49.007708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:49.007708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=16 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:49.008486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:48:49.009395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:48:49.009544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Wed Oct 12 12:48:49 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d (ip 10.222.0.44) !!! Oct 12 12:48:49.016829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:49.017311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:49.017746 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:49.018480 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:49.018936 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:49.019396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:49.044428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:48:49.365681 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0a2c7d36-f208-4287-8201-2271faedd301 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 204 len: 0 microversion: 2.1 time: 0.365169 Oct 12 12:48:49.366301 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 513/1046] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:48:48 2022] DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 0 bytes in 367 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:48:49.374828 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:49.375476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:49.382952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:49.386869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:49.386869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:49.386869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:49.386869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:49.387279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:49.514444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:49.522437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1e21d4a5-f5b5-4a72-b146-90364aeddd97 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1674 microversion: 2.1 time: 0.151860 Oct 12 12:48:49.523001 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 534/1047] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:49 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:50.545842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:50.546570 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:50.552968 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:50.558006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:50.558006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:50.558006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:50.558006 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:50.558371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:50.685284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:50.693770 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0e5104f0-6b41-4865-9036-4fc81cb6f364 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1674 microversion: 2.1 time: 0.152178 Oct 12 12:48:50.694380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 514/1048] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:50 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:51.716862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:51.717519 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:51.725188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:51.725643 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:51.726088 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:51.726778 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:51.727262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:51.727686 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:51.858107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:51.865958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0182fe35-d0a5-496e-9ea4-6a8b53276912 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1674 microversion: 2.1 time: 0.153113 Oct 12 12:48:51.866572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 535/1049] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:51 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:48:52.311258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7eff460-0340-44df-bc50-1b3d50f3aa9d", "name": "network-vif-deleted", "tag": "d3627907-d8ad-4f99-b54e-5162888fde02"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:48:52.321454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:52.322048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:52.322541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:52.334596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] Creating event network-vif-deleted:d3627907-d8ad-4f99-b54e-5162888fde02 for instance f7eff460-0340-44df-bc50-1b3d50f3aa9d on hv-cinder-81268 Oct 12 12:48:52.340343 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-7ffaa801-2fcd-452e-86f9-304c65595e60 req-43ebef3f-2664-49cb-8f5f-21db3d6f80e2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092473 Oct 12 12:48:52.341353 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 515/1050] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:48:52.890040 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:52.890660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:52.897945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:52.898444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:52.898881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:52.899586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:52.900048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:52.900475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:52.966106 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:52.974595 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-86165469-3794-4481-936a-39428ea508cb tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1606 microversion: 2.1 time: 0.088371 Oct 12 12:48:52.975191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 536/1051] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:52 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1606 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:53.998282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:53.998892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:54.006216 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:54.006721 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:54.007150 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:54.007827 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:54.008277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:54.008690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:54.069803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:54.077694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-cd09fe28-2186-4de3-9866-b93ba61c7749 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1606 microversion: 2.1 time: 0.083731 Oct 12 12:48:54.078390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 516/1052] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:53 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1606 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:55.101287 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:55.101896 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:55.107848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:55.108329 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:55.108767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:55.109452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:55.109906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:55.110355 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:55.140755 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:55.141232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:55.141666 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:55.142157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.objects.instance [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lazy-loading 'fault' on Instance uuid f7eff460-0340-44df-bc50-1b3d50f3aa9d {{(pid=130867) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:48:55.181052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:55.188557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c101f32e-2888-475e-8594-155dab5dc4d2 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 200 len: 1328 microversion: 2.1 time: 0.091408 Oct 12 12:48:55.189121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 537/1053] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:55 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 1328 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:48:56.212749 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:56.213385 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:56.219372 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:56.219878 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:56.220297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:56.220998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:56.221456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:56.221884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:56.235739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d HTTP/1.1 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:48:56.237358 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:48:56.239054 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'f7eff460-0340-44df-bc50-1b3d50f3aa9d'} Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:48:56.239992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:48:56.241519 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:48:56.245898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:48:56.245898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e95fd67d-8fd9-4742-9b13-3e54d170fac7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 404 len: 111 microversion: 2.1 time: 0.030186 Oct 12 12:48:56.245898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 517/1054] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:56 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:48:56.250549 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-928cd422-0699-4067-b472-d0864242acae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '.version_select at 0x7f9805512e50>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:56.323594 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-928cd422-0699-4067-b472-d0864242acae tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073236850" status: 202 len: 0 microversion: 2.1 time: 0.076818 Oct 12 12:48:56.325283 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 538/1055] 10.222.0.44 () {58 vars in 1221 bytes} [Wed Oct 12 12:48:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1073236850 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:48:57.078214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c117eb3d-7a60-4289-bac1-83b50476d0c5 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: .version_select at 0x7f980542a5e0>, body: {"keypair": {"name": "tempest-keypair-206635049", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8dAXihq8fLU3SC4J9bwMvO6thstTw5Hb8f0v0FgWDfqVF+TRGnC5XGXXsOWSG8hgFB5TaUU2m1odt46MkUpKNW7EdUsmF/XVSKzC2xoENveYlYh6LLbzfo/IEpGZEuZw=="}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:48:57.093495 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-c117eb3d-7a60-4289-bac1-83b50476d0c5 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for project 3ebab900aef740b68af799c4695e6e5f. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:48:57.097253 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-c117eb3d-7a60-4289-bac1-83b50476d0c5 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for user f84e6adb1a0e4d709b2962c9793346dc and project 3ebab900aef740b68af799c4695e6e5f. Resources: {'key_pairs'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:48:57.178513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c117eb3d-7a60-4289-bac1-83b50476d0c5 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.104213 Oct 12 12:48:57.179104 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 518/1056] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:48:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:48:59.252628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-601920394", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3056a6cc-68c2-4250-940c-4ab601619b85"}], "security_groups": [{"name": "tempest-securitygroup--1580661775"}], "key_name": "tempest-keypair-206635049", "user_data": "}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:48:59.354489 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] validate_networks() for [('3056a6cc-68c2-4250-940c-4ab601619b85', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:48:59.733048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:48:59.733463 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:48:59.733977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:48:59.734406 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:48:59.734809 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:48:59.744045 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:59.744521 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:59.744947 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:59.745661 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:48:59.746143 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:48:59.746565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:48:59.764375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for project 3ebab900aef740b68af799c4695e6e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:48:59.768399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Getting quotas for user f84e6adb1a0e4d709b2962c9793346dc and project 3ebab900aef740b68af799c4695e6e5f. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:48:59.779256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:48:59.781505 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:48:59.893893 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-30173ffa-d7b7-4f5c-921e-c847f7a38a92 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.646148 Oct 12 12:48:59.894645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 539/1057] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:48:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:48:59.906643 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f7d77ccc-19bb-4d8f-95ae-f0a7e8843dee tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:48:59.907359 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f7d77ccc-19bb-4d8f-95ae-f0a7e8843dee tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:48:59.963492 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f7d77ccc-19bb-4d8f-95ae-f0a7e8843dee tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:48:59.970387 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f7d77ccc-19bb-4d8f-95ae-f0a7e8843dee tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1236 microversion: 2.1 time: 0.068402 Oct 12 12:48:59.970953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 519/1058] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:48:59 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1236 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:00.672602 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-875561390", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1979552841", "security_groups": [{"name": "tempest-secgroup-smoke-292163129"}], "block_device_mapping_v2": [{"uuid": "047cd48a-2f6f-4a69-92b4-2feb6582fe65", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "3df10711-3511-48ea-bbdd-b691bad6a273"}]}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:00.790432 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.network.neutron [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] validate_networks() for [('3df10711-3511-48ea-bbdd-b691bad6a273', None, None, None, None, None)] {{(pid=130867) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:49:00.992705 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:00.993950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:01.000398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:01.000886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:01.001333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:01.002048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:01.002499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:01.002923 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:01.064483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:01.075123 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9c5c1a92-e8d8-403e-950c-e074d72e521a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1240 microversion: 2.1 time: 0.086242 Oct 12 12:49:01.075713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 520/1059] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:00 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1240 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:01.166936 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:49:01.167361 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image limits 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:49:01.167858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Flavor pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:49:01.168265 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Image pref 0:0:0 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:49:01.168679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.virt.hardware [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130867) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:49:01.177784 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:01.184626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:01.184626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:01.184626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:01.184626 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:01.185012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:01.197399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:49:01.201176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Getting quotas for user 205b19ccb80a45fd8ed36abd2c4c32c3 and project 00c9aab9a0264449ac51194afd4cb6a9. Resources: {'instances', 'cores', 'ram'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:49:01.263763 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Going to run 1 instances... {{(pid=130867) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:49:01.266163 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='047cd48a-2f6f-4a69-92b4-2feb6582fe65',volume_size=None,volume_type=None)] {{(pid=130867) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:49:01.741431 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e6cd1e45-3857-4249-a2fc-5ed02bb54814 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.073175 Oct 12 12:49:01.742409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 540/1060] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:49:00 2022] POST /compute/v2.1/servers => generated 405 bytes in 1075 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:49:01.753532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e9036fc5-e269-42dc-8317-ed9ec8d9c4ec tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:01.755523 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e9036fc5-e269-42dc-8317-ed9ec8d9c4ec tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:01.807976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e9036fc5-e269-42dc-8317-ed9ec8d9c4ec tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:01.814978 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e9036fc5-e269-42dc-8317-ed9ec8d9c4ec tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1094 microversion: 2.1 time: 0.065432 Oct 12 12:49:01.822605 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 521/1061] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:01 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:02.099289 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:02.102065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:02.107208 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:02.107812 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:02.108345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:02.109404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:02.110028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:02.111727 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:02.186371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:02.194337 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b56f4b75-32a4-4d29-b3c8-9f22258b7081 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1296 microversion: 2.1 time: 0.100032 Oct 12 12:49:02.194912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 541/1062] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:02 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1296 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:02.836992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:02.837674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:02.844601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:02.845099 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:02.845640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:02.847722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:02.847722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:02.847722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:03.195572 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:03.204571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ba774d6a-50ef-476d-a2d6-6111dc28266e tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1144 microversion: 2.1 time: 0.371533 Oct 12 12:49:03.205483 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 522/1063] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:02 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1144 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:03.223773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:03.224447 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:03.231300 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:03.231791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:03.232226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:03.232928 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:03.233385 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:03.233811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:03.376472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:03.384677 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5b013adb-3dd7-4ba0-8b3e-519dcc62f312 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.165319 Oct 12 12:49:03.385243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 542/1064] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:03 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:04.212470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3", "tag": "7f3980ee-9661-4485-8118-4ab7f72717b9"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:04.227892 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:04.228117 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:04.228857 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:04.229168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:04.229617 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:04.236168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:04.236975 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:04.237648 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:04.238892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:04.239589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:04.240231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:04.242686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] Creating event network-changed:7f3980ee-9661-4485-8118-4ab7f72717b9 for instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 on hv-cinder-81268 Oct 12 12:49:04.248464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-3f282efb-bae7-4aad-ae2c-3096a9b86b1e req-5069730b-b8f6-4c8f-9adb-4eb5e4cf11ad service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040322 Oct 12 12:49:04.249620 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 523/1065] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:04.310371 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:04.322343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-64182c5b-6b8c-45ae-8648-022e9749ab29 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1210 microversion: 2.1 time: 0.098529 Oct 12 12:49:04.323028 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 543/1066] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:04 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1210 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:49:04.407907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:04.408690 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:04.416061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:04.416880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:04.417571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:04.418426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:04.419107 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:04.419790 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:04.629220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:04.638378 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5b5bc352-b335-4837-af4e-7f584f69e314 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.234576 Oct 12 12:49:04.639998 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 524/1067] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:04 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:05.351542 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:05.352167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:05.360325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:05.360325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:05.360325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:05.360628 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:05.361069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:05.361499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:05.555122 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:05.562811 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-94a0ed72-27d7-42de-b112-84d97b761701 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1277 microversion: 2.1 time: 0.215908 Oct 12 12:49:05.563601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 544/1068] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:05 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:05.662773 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:05.663623 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:05.669696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:05.670205 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:05.670652 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:05.671323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:05.671768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:05.672184 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:05.789881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa4101-df8e-461b-aedd-2ff1670fef45", "tag": "49d575f2-339d-45f5-a550-3c864bdab81a"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:05.799400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:05.799905 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:05.800335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:05.803866 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:05.811367 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] Creating event network-changed:49d575f2-339d-45f5-a550-3c864bdab81a for instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 on hv-cinder-81268 Oct 12 12:49:05.814092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5f16ffeb-d0d7-4abf-a299-56f5eb94dd83 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.153497 Oct 12 12:49:05.814092 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 525/1069] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:05 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:05.827597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-2aceca02-80d0-4269-8d97-28f1684d7ded req-86ec980a-de8a-4b3e-b7b7-297e98b0d691 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109708 Oct 12 12:49:05.828210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 545/1070] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:49:06.584770 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:06.585482 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:06.592238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:06.592720 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:06.593158 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:06.593898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:06.594377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:06.594808 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:06.736831 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:06.746640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e7a4aebc-2c6d-4f78-bfbe-3b018c7d26e8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.165575 Oct 12 12:49:06.753982 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 526/1071] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:06 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:06.837090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:06.837973 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:06.844696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:06.845279 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:06.845792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:06.846596 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:06.847148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:06.847645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:07.048470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:07.056845 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b838757c-0084-4258-a2f0-8701a73fcd8c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.224954 Oct 12 12:49:07.057486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 546/1072] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:06 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:07.770204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:07.771422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:07.777863 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:07.778380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:07.778809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:07.779498 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:07.779952 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:07.780377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:07.907809 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:07.915593 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5114ca3b-2e2f-4d28-9d61-b6ae113c5e1a tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.149328 Oct 12 12:49:07.916161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 527/1073] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:07 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:08.079558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:08.080165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:08.086599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:08.087076 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:08.087502 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:08.088187 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:08.088636 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:08.089055 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:08.214773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:08.222320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f9274d88-b2ba-4319-9250-f377d5c27eba tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.146557 Oct 12 12:49:08.222880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 547/1074] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:08 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:08.879822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3", "name": "network-vif-plugged", "status": "completed", "tag": "7f3980ee-9661-4485-8118-4ab7f72717b9"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:08.889464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:08.889953 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:08.890532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:08.901539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] Creating event network-vif-plugged:7f3980ee-9661-4485-8118-4ab7f72717b9 for instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 on hv-cinder-81268 Oct 12 12:49:08.906513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-d7994ae7-8f92-4388-bc04-38d85409f84e req-f194f747-e189-4b51-9be9-0e378e18f93e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085727 Oct 12 12:49:08.911673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 528/1075] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:08.938515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:08.939282 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:08.945207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:08.945767 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:08.946248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:08.946945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:08.947422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:08.947854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:09.086047 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:09.094125 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7746bba4-ee9e-4449-a80a-2e029950eeb3 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.159374 Oct 12 12:49:09.094696 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 548/1076] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:08 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:09.245380 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:09.246119 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:09.252287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:09.252781 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:09.253224 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:09.253969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:09.254613 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:09.255768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:09.382853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:09.390415 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e901af06-010d-4bf6-8b60-ef26f59392af tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.149409 Oct 12 12:49:09.390983 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 529/1077] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:09 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:10.116583 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:10.117192 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:10.123652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:10.124134 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:10.124565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:10.125250 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:10.125697 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:10.126148 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:10.256599 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:10.264228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ec0836c4-775b-41f6-8300-62bfaf1dfeb4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.152130 Oct 12 12:49:10.264793 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 549/1078] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:10 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:10.413230 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:10.413792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:10.420244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:10.420724 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:10.421156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:10.421841 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:10.422322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:10.422747 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:10.553543 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:10.561156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-51dd28ca-9f4a-4e74-8a48-db7ca4f94d14 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1362 microversion: 2.1 time: 0.152536 Oct 12 12:49:10.561724 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 530/1079] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:10 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1362 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:11.288168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:11.288774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:11.291186 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=4 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:11.291862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=12 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:11.296538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.297022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.297448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.298164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.298611 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.299031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.426439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:11.434591 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b94a4c9b-ce6d-40e8-863c-936b006642e9 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.150900 Oct 12 12:49:11.435157 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 550/1080] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:11 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:11.588308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:11.588914 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:11.595318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.595792 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.596220 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.596897 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.597379 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.597803 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.727274 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:11.734884 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-199e91d3-5edc-4390-9552-c2414a07d370 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1549 microversion: 2.1 time: 0.150488 Oct 12 12:49:11.735455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 531/1081] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:11 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1549 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:11.757063 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:11.757555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:11.763361 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.763915 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.764347 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.765029 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:11.765484 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:11.765909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:11.841415 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-36badab6-4545-4a74-bc58-c90ea8253ce1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088327 Oct 12 12:49:11.842044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 551/1082] 10.222.0.44 () {58 vars in 1275 bytes} [Wed Oct 12 12:49:11 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:12.456632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:12.457250 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:12.459286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=8 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:12.464034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:12.464522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:12.464957 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:12.465662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:12.466148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:12.466576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:12.683175 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:12.690933 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ce90ae85-eaaa-4cdf-b00f-9819ba0cf8db tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.238196 Oct 12 12:49:12.691503 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 532/1083] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:12 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:12.888212 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3", "tag": "7f3980ee-9661-4485-8118-4ab7f72717b9"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:12.897391 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:12.897956 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:12.898452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:12.909227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] Creating event network-changed:7f3980ee-9661-4485-8118-4ab7f72717b9 for instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 on hv-cinder-81268 Oct 12 12:49:12.914951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-b0b832d0-1001-4a74-8b18-aa3981c906cb req-efe7139b-fc70-45c5-833d-f04bdaabfc40 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030984 Oct 12 12:49:12.915786 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 552/1084] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:13.715296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:13.716012 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:13.723014 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:13.723845 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:13.724535 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:13.725243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:13.725692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:13.726137 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:13.756980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:13.872375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:13.879867 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d671608e-7989-4a86-92aa-4672996035e4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.168475 Oct 12 12:49:13.880682 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 533/1085] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:13 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:14.904403 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:14.905164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:14.911311 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:14.911796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:14.912261 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:14.913025 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:14.913487 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:14.913912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:14.918365 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=100 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:15.045421 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:15.053646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ab3b744c-254c-4eda-9ab9-b799c49227b2 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.153287 Oct 12 12:49:15.054249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 553/1086] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:14 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:16.076135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:16.076742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:16.083852 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:16.084327 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:16.085427 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:16.086147 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:16.086598 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:16.087017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:16.213023 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:16.220540 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-bd616ffd-ca6b-442b-8102-0c4fac2dcda5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.148243 Oct 12 12:49:16.221109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 534/1087] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:16 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:16.863925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfa4101-df8e-461b-aedd-2ff1670fef45", "name": "network-vif-plugged", "status": "completed", "tag": "49d575f2-339d-45f5-a550-3c864bdab81a"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:16.874169 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:16.874892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:16.875325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:16.886440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] Creating event network-vif-plugged:49d575f2-339d-45f5-a550-3c864bdab81a for instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 on hv-cinder-81268 Oct 12 12:49:16.891325 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-396dace1-8460-4b8c-b240-cf397f1641af req-cfc15c9b-2592-44e0-a08a-6f386866204c service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031044 Oct 12 12:49:16.891949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 554/1088] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:17.243198 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:17.243734 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:17.250284 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:17.250774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:17.251203 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:17.251894 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:17.252347 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:17.252768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:17.386213 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:17.393853 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e3068c3b-2772-443c-9e2e-77d580ce9cbd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.154639 Oct 12 12:49:17.394449 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 535/1089] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:17 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:49:18.418419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:18.419031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:18.425052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:18.425531 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:18.425988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:18.426679 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:18.427126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:18.427547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:18.559425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:18.567107 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-755e19dd-ca0b-4295-8f4a-386b33fe55aa tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1265 microversion: 2.1 time: 0.154122 Oct 12 12:49:18.567645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 555/1090] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:18 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:19.588947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:19.589712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:19.592077 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:19.596702 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:19.597190 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:19.597670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:19.598356 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:19.598812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:19.599233 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:19.729254 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:19.737434 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-00ccaeae-56aa-4e8a-9f25-3df845f1be50 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1453 microversion: 2.1 time: 0.152422 Oct 12 12:49:19.738060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 536/1091] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:19 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:19.760477 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:19.761090 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:19.763539 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=76,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:19.768226 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:19.768712 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:19.769155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:19.769847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:19.770597 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:19.771197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:19.904098 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:49:19.912639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-07ad363b-3d9a-4e4a-8bfa-98806a0420ef tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1453 microversion: 2.1 time: 0.155956 Oct 12 12:49:19.913750 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 556/1092] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:49:19 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1453 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:49:21.747239 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa4101-df8e-461b-aedd-2ff1670fef45", "tag": "49d575f2-339d-45f5-a550-3c864bdab81a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:21.758364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:21.758838 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:21.759265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:21.770688 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] Creating event network-changed:49d575f2-339d-45f5-a550-3c864bdab81a for instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 on hv-cinder-81268 Oct 12 12:49:21.776319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-cd557653-1a7a-4d2b-8fa5-266fb1840079 req-8d8b8314-b07a-457e-a00b-4b2368e34fc2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032845 Oct 12 12:49:21.777112 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 537/1093] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:49:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:48.716524 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:48.717103 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:48.719351 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=18 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:48.723925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:48.724399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:48.724826 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:48.725501 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:48.725965 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:48.726386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:48.750013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a82cb55f-6d79-415e-bf04-dc2ea763bab9 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/ips" status: 200 len: 146 microversion: 2.1 time: 0.037462 Oct 12 12:49:48.750573 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 557/1094] 10.222.0.44 () {58 vars in 1248 bytes} [Wed Oct 12 12:49:48 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/ips => generated 146 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:50.350248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "39d3cc36-3802-40d8-856e-3789529be3c0"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:49:50.353246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:50.355578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:50.356378 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=22 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:49:50.361053 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:50.361606 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:50.362082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:50.374555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:50.374555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:50.374555 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:51.079501 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-d8cbfeac-adf9-4ba8-a803-a72c2e2535e7 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.733432 Oct 12 12:49:51.080120 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 538/1095] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:49:50 2022] POST /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 194 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:58.603678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:58.606534 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:58.612797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:58.613274 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:58.613705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:58.614405 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:58.614850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:58.615267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:58.644400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-79671176-e699-420b-9e28-910a4f9f1993 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044778 Oct 12 12:49:58.644931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 558/1096] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:49:58 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:49:58.656096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:49:58.658824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:49:58.663454 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:58.663935 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:58.664435 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:58.665126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:49:58.665578 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:49:58.666022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:49:58.695297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b7d67cfa-4153-49e8-aa67-d0e908315259 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0" status: 200 len: 194 microversion: 2.1 time: 0.043449 Oct 12 12:49:58.695866 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 539/1097] 10.222.0.44 () {58 vars in 1413 bytes} [Wed Oct 12 12:49:58 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:00.281503 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "27ebee07-f7cf-4dd3-98a5-61ef7015227d"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:50:00.284056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:00.290493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:00.290974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:00.291409 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:00.292738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:00.293189 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:00.293609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:01.167669 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-31c88664-6007-4737-bcde-b5984fabeb91 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "POST /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889980 Oct 12 12:50:01.168376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 559/1098] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:50:00 2022] POST /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 194 bytes in 892 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:08.692797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:08.692797 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:08.695542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=4 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:08.696188 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=17,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:08.699521 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.700036 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.700470 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:08.701161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.701612 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.702062 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:08.732460 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-159b3804-b8e2-447f-85aa-85843f3bcfb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046574 Oct 12 12:50:08.738413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 540/1099] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:50:08 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:08.872488 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:08.873070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:08.879266 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.879744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.880174 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:08.880860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.881309 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.882096 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:08.911860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-61b419d0-9095-4133-9068-e898e728ee0b tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0" status: 200 len: 194 microversion: 2.1 time: 0.044342 Oct 12 12:50:08.912437 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 560/1100] 10.222.0.44 () {58 vars in 1413 bytes} [Wed Oct 12 12:50:08 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:08.923780 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:08.924277 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:08.930788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.931271 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.931706 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:08.932395 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:08.932847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:08.933273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:09.014021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lazy-loading 'services' on Instance uuid b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:50:09.195227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5c08678e-2be8-4056-a774-4208b51d79e1 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0" status: 202 len: 0 microversion: 2.1 time: 0.275883 Oct 12 12:50:09.195833 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 541/1101] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:50:08 2022] DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/39d3cc36-3802-40d8-856e-3789529be3c0 => generated 0 bytes in 277 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:50:11.370759 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:11.371440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:11.378395 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:11.378877 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:11.379306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:11.379986 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:11.380435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:11.380851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:11.409557 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-582b7c90-dd50-4a51-8869-7d0221ea634c tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/27ebee07-f7cf-4dd3-98a5-61ef7015227d" status: 200 len: 194 microversion: 2.1 time: 0.042744 Oct 12 12:50:11.410142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 561/1102] 10.222.0.44 () {58 vars in 1413 bytes} [Wed Oct 12 12:50:11 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/27ebee07-f7cf-4dd3-98a5-61ef7015227d => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:11.422298 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:11.422893 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:11.428943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:11.429428 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:11.429868 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:11.430590 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:11.431049 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:11.431476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:11.509563 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lazy-loading 'services' on Instance uuid b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:50:11.714722 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-01f0ceae-5568-455b-8809-8db024cf5884 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/27ebee07-f7cf-4dd3-98a5-61ef7015227d" status: 202 len: 0 microversion: 2.1 time: 0.297624 Oct 12 12:50:11.715490 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 542/1103] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:50:11 2022] DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments/27ebee07-f7cf-4dd3-98a5-61ef7015227d => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:50:12.887197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:12.889837 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:12.896217 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:12.896764 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:12.897216 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:12.897919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:12.898400 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:12.898824 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:12.929240 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a671a58f-a7ae-4726-9531-776c7b8d2b49 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047138 Oct 12 12:50:12.929804 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 562/1104] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:50:12 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:50:13.045557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:13.047909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:13.054457 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.061818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.061818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.061818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.061818 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.062225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.085313 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-838e712c-6f6c-4e05-93b7-8be17c176d0e tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044612 Oct 12 12:50:13.085860 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 543/1105] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:50:13 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:50:13.166689 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:13.167179 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:13.173552 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.174064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.174493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.175173 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.175638 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.176038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.200070 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:50:13.489738 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-83fe6549-4811-4d02-a222-0ba5527f077d tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 204 len: 0 microversion: 2.1 time: 0.326518 Oct 12 12:50:13.490352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 563/1106] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:50:13 2022] DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:50:13.498341 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:13.499938 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:13.504950 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.505431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.505856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.506580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:13.507308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:13.507725 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:13.640124 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:50:13.647829 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e3007b53-06de-40fd-a204-c2027ad0915a tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1673 microversion: 2.1 time: 0.153290 Oct 12 12:50:13.648371 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 544/1107] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:13 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:50:14.671578 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:14.672304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:14.678663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:14.679140 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:14.679703 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:14.680382 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:14.680830 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:14.681249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:14.812892 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:50:14.820556 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ea2a5578-49f6-49d3-bd7c-d817f06e7163 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1673 microversion: 2.1 time: 0.153989 Oct 12 12:50:14.821119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 564/1108] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:14 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1673 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:50:15.844436 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:15.845048 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:15.851589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:15.852075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:15.852510 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:15.853210 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:15.853661 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:15.854115 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:15.984957 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:50:15.992764 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-acae7b91-96be-4ae3-8a11-0d54923dcf05 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1673 microversion: 2.1 time: 0.152197 Oct 12 12:50:15.993329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 545/1109] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:15 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1673 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:50:16.666074 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3", "name": "network-vif-deleted", "tag": "7f3980ee-9661-4485-8118-4ab7f72717b9"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:50:16.676593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:16.677008 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:16.677440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:16.690912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] Creating event network-vif-deleted:7f3980ee-9661-4485-8118-4ab7f72717b9 for instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 on hv-cinder-81268 Oct 12 12:50:16.695960 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-a640a647-e01d-4c83-81be-b31da61fe3e4 req-a432dfa8-82fa-4370-8861-2726b60cbb4f service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033660 Oct 12 12:50:16.697083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 565/1110] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:50:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:50:17.016145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:17.016703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:17.023093 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:17.023592 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:17.024018 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:17.024708 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:17.025167 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:17.025585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:17.058084 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:17.058632 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:17.059081 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:17.059557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lazy-loading 'fault' on Instance uuid b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:50:17.108886 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f84e6adb1a0e4d709b2962c9793346dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3ebab900aef740b68af799c4695e6e5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:50:17.118579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b154d82c-028c-4c63-9f07-7a7707becbb6 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 200 len: 1326 microversion: 2.1 time: 0.106978 Oct 12 12:50:17.119214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 546/1111] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:17 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 1326 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:50:18.144126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:18.144785 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:18.150988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:18.151470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:18.151894 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:18.152576 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:18.153024 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:18.153439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:18.167053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 HTTP/1.1 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:50:18.168663 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:18.170389 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3'} Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:50:18.171373 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:18.172923 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:18.174449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:50:18.174449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1a48ef9a-cec1-4b5f-83b0-98fe4dcb02ff tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 404 len: 111 microversion: 2.1 time: 0.030623 Oct 12 12:50:18.174449 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 566/1112] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:18 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:50:18.179579 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-893a32d4-daa9-4d2f-8488-4101f3413818 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '.version_select at 0x7f98052cb670>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:18.251721 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-893a32d4-daa9-4d2f-8488-4101f3413818 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-206635049" status: 202 len: 0 microversion: 2.1 time: 0.075828 Oct 12 12:50:18.252303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 547/1113] 10.222.0.44 () {58 vars in 1218 bytes} [Wed Oct 12 12:50:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-206635049 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:50:21.583156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:21.583708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:21.586221 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:50:21.590989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:21.591474 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:21.591910 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:21.592647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:21.593108 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:21.593536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:21.607200 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 HTTP/1.1 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:50:21.609278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.611399 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3'} Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:50:21.612306 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.613924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.617112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:50:21.617112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9376640f-9199-4d3f-b92b-c143435affaa tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 404 len: 111 microversion: 2.1 time: 0.031465 Oct 12 12:50:21.617112 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 567/1114] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:50:21 2022] DELETE /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:50:21.619526 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:21.620149 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:21.627694 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:21.628181 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:21.628622 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:21.629319 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:21.629776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:21.630229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:21.643577 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 HTTP/1.1 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:50:21.645276 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.647655 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3'} Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:50:21.648456 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. Oct 12 12:50:21.649913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:21.651243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:50:21.651243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-b0c97e64-a7b0-4f2f-b3f1-26282c520054 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3" status: 404 len: 111 microversion: 2.1 time: 0.030973 Oct 12 12:50:21.651243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 548/1115] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:21 2022] GET /compute/v2.1/servers/b7e67f68-f21f-4a9e-94bf-5c6ba7376ed3 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:50:22.907982 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:22.908459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:22.914968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:22.915472 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:22.915903 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:22.916590 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:22.917039 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:22.917459 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:22.931304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d HTTP/1.1 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:50:22.932831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.934468 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'f7eff460-0340-44df-bc50-1b3d50f3aa9d'} Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:50:22.935375 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.936974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.938801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:50:22.938801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-43d1598d-0acb-43fe-957d-a07f9d9f4a75 tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 404 len: 111 microversion: 2.1 time: 0.031032 Oct 12 12:50:22.938801 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 568/1116] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:50:22 2022] DELETE /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:50:22.942744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:50:22.943377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] [instance: f7eff460-0340-44df-bc50-1b3d50f3aa9d] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:50:22.949743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:22.950259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:22.950697 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:22.951397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:50:22.951847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:50:22.952263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:50:22.965214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] HTTP exception thrown: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Request method failure captured: Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d HTTP/1.1 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrcG2MBD_KNNoUCerSI6_DdeR1xeCuXBog49XsMaZflFZPpWare32EdmwJjwxGWDvKw_fMz-htJ4nP3lub0a5grQhusg8UcXJFb1IhhHqdIwjG7NVqJmw7JFWbwaAabXL8HMNgrOvBMYQcDBoHtX_iDWpi1eXVAuH8atP6eOiwcIhS4 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:50:22.966712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/3ebab900aef740b68af799c4695e6e5f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_3ebab900aef740b68af799c4695e6e5f", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 3ebab900aef740b68af799c4695e6e5f Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-AttachVolumeTestJSON-2018983956 Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: f84e6adb1a0e4d709b2962c9793346dc Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-AttachVolumeTestJSON-2018983956-project Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.968864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'f7eff460-0340-44df-bc50-1b3d50f3aa9d'} Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:50:22.969880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. Oct 12 12:50:22.971368 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:50:22.972698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] Returning 404 to user: Instance f7eff460-0340-44df-bc50-1b3d50f3aa9d could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:50:22.972698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ae96c3f5-0e55-4173-8f7a-289595b3a7ce tempest-AttachVolumeTestJSON-2018983956 tempest-AttachVolumeTestJSON-2018983956-project] 10.222.0.44 "GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d" status: 404 len: 111 microversion: 2.1 time: 0.029671 Oct 12 12:50:22.972698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 549/1117] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:50:22 2022] GET /compute/v2.1/servers/f7eff460-0340-44df-bc50-1b3d50f3aa9d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:51:01.593037 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:01.593862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:01.595094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dfa4101-df8e-461b-aedd-2ff1670fef45", "tag": "49d575f2-339d-45f5-a550-3c864bdab81a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:01.600529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:01.600778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:51:01.601659 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Wed Oct 12 12:51:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.44) !!! Oct 12 12:51:01.603173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=23,nova_api:DELETE=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:01.603372 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:01.604005 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:01.604463 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=54,nova_cell1:INSERT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:01.604644 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:01.605911 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:01.607075 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:01.607610 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:01.612520 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:01.612997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:01.613601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:01.625464 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] Creating event network-changed:49d575f2-339d-45f5-a550-3c864bdab81a for instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 on hv-cinder-81268 Oct 12 12:51:01.630755 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-26a71223-53f7-4416-8960-2840954cb50b req-dcf2144b-6ee3-40f2-944f-d296d6e9a7b2 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039434 Oct 12 12:51:01.632019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 550/1118] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:01.637237 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:51:01.973323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bbebf648-6021-4c42-a399-d94c78e83eff tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "DELETE /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 204 len: 0 microversion: 2.1 time: 0.384728 Oct 12 12:51:01.974288 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 569/1119] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:51:01 2022] DELETE /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:51:01.983439 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:01.988936 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:01.991989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:01.992478 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:01.993113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:01.993822 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:01.994438 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:01.994869 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:02.151140 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:02.161502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ee235bd7-5f5d-4dee-b642-a7aedffe604f tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1578 microversion: 2.1 time: 0.182820 Oct 12 12:51:02.162098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 551/1120] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:01 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1578 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:51:03.185350 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:03.186476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:03.195038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:03.195716 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:03.196160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:03.196859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:03.197817 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:03.198278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:03.336207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:03.344012 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f279dbbd-b74f-40e6-b236-5c133808f9e5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1578 microversion: 2.1 time: 0.163000 Oct 12 12:51:03.344574 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 570/1121] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:03 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1578 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:04.208976 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dfa4101-df8e-461b-aedd-2ff1670fef45", "name": "network-vif-deleted", "tag": "49d575f2-339d-45f5-a550-3c864bdab81a"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:04.219391 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:04.219862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:04.220286 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:04.231390 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] Creating event network-vif-deleted:49d575f2-339d-45f5-a550-3c864bdab81a for instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 on hv-cinder-81268 Oct 12 12:51:04.236421 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-de75df8e-edd0-46f1-8dff-3ddcead92176 req-e979d2c9-e40d-4009-bad9-0a48b7f40227 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Oct 12 12:51:04.237089 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 552/1122] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:04.367316 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:04.367900 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:04.374789 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:04.375264 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:04.375708 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:04.376379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:04.376831 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:04.377254 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:04.439238 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:04.447126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-fb663f40-ccca-4c56-9f3d-f099a3162ddd tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1392 microversion: 2.1 time: 0.083803 Oct 12 12:51:04.447689 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 571/1123] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:04 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1392 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:05.471500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:05.472200 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:05.479060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:05.479537 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:05.479966 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:05.480658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:05.481109 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:05.481531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:05.515169 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:05.515916 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:05.516082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:05.516531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lazy-loading 'fault' on Instance uuid 6dfa4101-df8e-461b-aedd-2ff1670fef45 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:51:05.558812 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:05.572689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-47bd326a-4324-4625-83b0-acbc1ac9d1d4 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 200 len: 1230 microversion: 2.1 time: 0.105412 Oct 12 12:51:05.573333 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 553/1124] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:05 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:06.596563 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:06.597206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 6dfa4101-df8e-461b-aedd-2ff1670fef45] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:06.603745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:06.604227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:06.604715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:06.605407 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:06.605862 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:06.606333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:06.620211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] HTTP exception thrown: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Request method failure captured: Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 HTTP/1.1 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrZ61wkDZuYWxjwsu4kNx-jd1YJVHIXjC5s91oDfRcn7WbRlEwkRnH9w5wkE20cumblp97B21XV0rr1IoZyW8nSNvM89hPbRBOSQt7C21XAslnMC7q2XOQtsZfGLssPRNkqiQGL3DnaobDqg8qMFsSMRk0SluDe9tRdUxNs5BXjj0GY Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:51:06.622044 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_00c9aab9a0264449ac51194afd4cb6a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 205b19ccb80a45fd8ed36abd2c4c32c3 Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. Oct 12 12:51:06.623692 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '6dfa4101-df8e-461b-aedd-2ff1670fef45'} Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:51:06.624586 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. Oct 12 12:51:06.625919 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:06.627647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Returning 404 to user: Instance 6dfa4101-df8e-461b-aedd-2ff1670fef45 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:51:06.627647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5581a7e6-814b-4f7d-aa53-4c5a345ddf52 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45" status: 404 len: 111 microversion: 2.1 time: 0.030803 Oct 12 12:51:06.627647 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 572/1125] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:06 2022] GET /compute/v2.1/servers/6dfa4101-df8e-461b-aedd-2ff1670fef45 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:51:09.979979 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:09.980626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:09.981734 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1c135a91-bcaa-4a50-b122-9b0f4eecb849", "tag": "d6a4edee-58a4-4b3d-9fa8-69ac36926da3"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:09.987561 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:09.988310 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:09.988839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:09.990318 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:09.990989 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:09.991662 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:09.992674 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:09.993156 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:09.993659 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:10.008866 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] Creating event network-changed:d6a4edee-58a4-4b3d-9fa8-69ac36926da3 for instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 on hv-cinder-81268 Oct 12 12:51:10.014142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-bdb26822-4734-4f69-a6c4-bbe8453fe4a1 req-561dfd9d-4a79-4137-aa34-525167e8f852 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035777 Oct 12 12:51:10.014799 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 573/1126] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:10.031566 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:51:10.343486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-bc2ab7ed-899f-41ed-8fc3-26a16deb3930 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 204 len: 0 microversion: 2.1 time: 0.365296 Oct 12 12:51:10.343486 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 554/1127] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:51:09 2022] DELETE /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 0 bytes in 368 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:51:10.351439 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:10.352141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:10.358272 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:10.358761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:10.359198 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:10.359887 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:10.360516 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:10.360951 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:10.508013 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:10.515660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-aa2f2ecf-3c37-462d-ba7b-08bb0bf93166 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1577 microversion: 2.1 time: 0.168849 Oct 12 12:51:10.534087 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 574/1128] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:10 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:11.545225 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:11.545948 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:11.552735 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:11.553215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:11.553638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:11.554352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:11.554801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:11.555215 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:11.695863 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:11.703636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a7ac3c2e-108c-4074-858d-4ecc68218360 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1577 microversion: 2.1 time: 0.162651 Oct 12 12:51:11.705076 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 555/1129] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:11 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:12.460131 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1c135a91-bcaa-4a50-b122-9b0f4eecb849", "name": "network-vif-deleted", "tag": "d6a4edee-58a4-4b3d-9fa8-69ac36926da3"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:12.470038 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:12.470517 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:12.471232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:12.482882 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] Creating event network-vif-deleted:d6a4edee-58a4-4b3d-9fa8-69ac36926da3 for instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 on hv-cinder-81268 Oct 12 12:51:12.487572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-de448414-b748-4b6e-a53d-e043bb454417 req-06c194a0-d695-4959-843a-b8425a4ed545 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031793 Oct 12 12:51:12.488180 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 575/1130] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:12.681030 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1614459749", "imageRef": "9e31b467-807e-4443-8756-c22aa323fb6c", "flavorRef": "452"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:12.726860 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:12.727523 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:12.730744 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] validate_networks() for None {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:51:12.733970 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:12.742705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:12.742705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:12.742705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:12.742705 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:12.743392 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:12.804732 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '205b19ccb80a45fd8ed36abd2c4c32c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '00c9aab9a0264449ac51194afd4cb6a9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:12.817126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-84acd65d-85ce-455d-b2d4-0728a92be346 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 200 len: 1225 microversion: 2.1 time: 0.094394 Oct 12 12:51:12.818144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 576/1131] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:12 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 1225 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:51:13.261595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:51:13.262034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:51:13.262502 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:51:13.262905 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:51:13.263317 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:51:13.272078 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:13.272552 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:13.272980 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:13.273713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:13.274170 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:13.274589 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:13.290860 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Getting quotas for project 172681aae5d649b7b8cc5dd50779a631. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:51:13.294771 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Getting quotas for user ed1e915d562a466cacb53942e1198333 and project 172681aae5d649b7b8cc5dd50779a631. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:51:13.305907 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:51:13.308194 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='9e31b467-807e-4443-8756-c22aa323fb6c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:51:13.433121 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-65dc2e84-e966-4b91-a2bb-74a24d91d7df tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.759394 Oct 12 12:51:13.433686 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 556/1132] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:51:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 761 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:51:13.445104 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-186c9e35-5a06-4c74-a2f4-1568fa1a8fb4 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:13.445735 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-186c9e35-5a06-4c74-a2f4-1568fa1a8fb4 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:13.499388 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-186c9e35-5a06-4c74-a2f4-1568fa1a8fb4 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:13.506448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-186c9e35-5a06-4c74-a2f4-1568fa1a8fb4 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1215 microversion: 2.1 time: 0.065264 Oct 12 12:51:13.507026 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 577/1133] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:13 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1215 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:13.841247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:13.841840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: 1c135a91-bcaa-4a50-b122-9b0f4eecb849] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:13.849567 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:13.850142 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:13.850575 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:13.851266 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:13.851713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:13.852135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:13.865002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] HTTP exception thrown: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Request method failure captured: Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 HTTP/1.1 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrZ61wkDZuYWxjwsu4kNx-jd1YJVHIXjC5s91oDfRcn7WbRlEwkRnH9w5wkE20cumblp97B21XV0rr1IoZyW8nSNvM89hPbRBOSQt7C21XAslnMC7q2XOQtsZfGLssPRNkqiQGL3DnaobDqg8qMFsSMRk0SluDe9tRdUxNs5BXjj0GY Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:51:13.866587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_00c9aab9a0264449ac51194afd4cb6a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 205b19ccb80a45fd8ed36abd2c4c32c3 Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. Oct 12 12:51:13.868227 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '1c135a91-bcaa-4a50-b122-9b0f4eecb849'} Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:51:13.869173 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. Oct 12 12:51:13.870842 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:13.872221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Returning 404 to user: Instance 1c135a91-bcaa-4a50-b122-9b0f4eecb849 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:51:13.872221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4f653226-02e1-4ce7-a648-61970b20b501 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849" status: 404 len: 111 microversion: 2.1 time: 0.031085 Oct 12 12:51:13.872221 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 557/1134] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:13 2022] GET /compute/v2.1/servers/1c135a91-bcaa-4a50-b122-9b0f4eecb849 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:51:14.528897 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:14.529536 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:14.538128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.538619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.539100 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.540042 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.540515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.540964 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.610868 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:14.620433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-04bddec8-c000-46c2-93ec-d6c3e7b31d66 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1219 microversion: 2.1 time: 0.095435 Oct 12 12:51:14.621095 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 578/1135] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:14 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:14.633820 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:14.634647 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:14.640585 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.641063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.641500 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.642238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.643004 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.643522 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.656609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] HTTP exception thrown: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Request method failure captured: Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: DELETE /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 HTTP/1.1 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrZ61wkDZuYWxjwsu4kNx-jd1YJVHIXjC5s91oDfRcn7WbRlEwkRnH9w5wkE20cumblp97B21XV0rr1IoZyW8nSNvM89hPbRBOSQt7C21XAslnMC7q2XOQtsZfGLssPRNkqiQGL3DnaobDqg8qMFsSMRk0SluDe9tRdUxNs5BXjj0GY Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:51:14.658162 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_00c9aab9a0264449ac51194afd4cb6a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: 205b19ccb80a45fd8ed36abd2c4c32c3 Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.670035 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': 'ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1'} Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:51:14.670949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.672571 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.674794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Returning 404 to user: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:51:14.674794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-383f1a2b-34c1-4465-8c08-e04f2454f7b8 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "DELETE /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 404 len: 111 microversion: 2.1 time: 0.030734 Oct 12 12:51:14.674794 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 558/1136] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:51:14 2022] DELETE /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:51:14.675056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:14.675056 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] [instance: ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:14.675533 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.676015 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.676448 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.677191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:14.677644 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:14.678101 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:14.692869 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] HTTP exception thrown: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Request method failure captured: Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 HTTP/1.1 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrZ61wkDZuYWxjwsu4kNx-jd1YJVHIXjC5s91oDfRcn7WbRlEwkRnH9w5wkE20cumblp97B21XV0rr1IoZyW8nSNvM89hPbRBOSQt7C21XAslnMC7q2XOQtsZfGLssPRNkqiQGL3DnaobDqg8qMFsSMRk0SluDe9tRdUxNs5BXjj0GY Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:51:14.694564 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/00c9aab9a0264449ac51194afd4cb6a9"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_00c9aab9a0264449ac51194afd4cb6a9", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 00c9aab9a0264449ac51194afd4cb6a9 Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-TestVolumeBootPattern-1483574079 Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 205b19ccb80a45fd8ed36abd2c4c32c3 Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-TestVolumeBootPattern-1483574079-project Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.696194 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': 'ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1'} Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:51:14.697093 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. Oct 12 12:51:14.698745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:51:14.702547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Returning 404 to user: Instance ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:51:14.702547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a0b962d8-9ebf-435c-b766-726106dd0b78 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1" status: 404 len: 111 microversion: 2.1 time: 0.031610 Oct 12 12:51:14.702547 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 579/1137] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:14 2022] GET /compute/v2.1/servers/ada6c2eb-6c4b-4fbb-9943-31ca8be9edd1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Oct 12 12:51:15.643649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:15.644309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:15.650875 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:15.651349 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:15.651772 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:15.652469 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:15.652896 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:15.653309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:15.715472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:15.723696 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-536b401c-bcd8-43d3-bf2c-58834b741264 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1267 microversion: 2.1 time: 0.083930 Oct 12 12:51:15.724330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 559/1138] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:15 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1267 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:16.191115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-8cd73163-aa0d-4e1b-877b-325016a639a5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] Calling method '.version_select at 0x7f9805446a60>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:16.282709 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-8cd73163-aa0d-4e1b-877b-325016a639a5 tempest-TestVolumeBootPattern-1483574079 tempest-TestVolumeBootPattern-1483574079-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1979552841" status: 202 len: 0 microversion: 2.1 time: 0.095031 Oct 12 12:51:16.283366 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 580/1139] 10.222.0.44 () {58 vars in 1263 bytes} [Wed Oct 12 12:51:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1979552841 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:51:16.751287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:16.751848 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:16.758398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:16.758876 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:16.759308 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:16.759995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:16.760442 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:16.760856 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:16.824943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:16.833248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6510fdb2-b2e3-4adc-ae2c-2416fd7611cf tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1273 microversion: 2.1 time: 0.086960 Oct 12 12:51:16.833819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 560/1140] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:16 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:17.862435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:17.863022 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:17.869700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:17.870207 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:17.870637 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:17.871579 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:17.872215 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:17.872650 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:18.182619 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:18.191690 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-398acda2-543b-43e9-9e26-899ab6ddd7f3 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.333585 Oct 12 12:51:18.192267 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 581/1141] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:17 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:18.926698 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e97cce9-cf98-4534-8979-2fbb122af629", "tag": "6d01a866-f829-4985-911d-955a971f9cce"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:18.936653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:18.937126 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:18.937550 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:18.950935 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] Creating event network-changed:6d01a866-f829-4985-911d-955a971f9cce for instance 8e97cce9-cf98-4534-8979-2fbb122af629 on hv-cinder-81268 Oct 12 12:51:18.956539 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-a929b239-8d5b-4a9c-8e66-6bf10aa8e6c0 req-6a115343-13ac-40dd-bc4b-69cc98366c2b service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033524 Oct 12 12:51:18.957692 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 561/1142] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:19.220030 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:19.221452 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:19.229988 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:19.230927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:19.231441 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:19.232223 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:19.232753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:19.233440 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:19.468443 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:19.480290 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-0e4f76cf-46ca-471e-915b-0e2cba179a95 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.268084 Oct 12 12:51:19.480955 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 582/1143] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:19 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:20.505403 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:20.506303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:20.513311 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:20.514855 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:20.516145 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:20.517129 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:20.517836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:20.518584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:20.718599 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:20.726719 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ca2441fe-eff4-4664-a5ce-be22bc62eba8 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.226452 Oct 12 12:51:20.727263 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 562/1144] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:20 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:21.752859 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:21.753529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:21.760191 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:21.760743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:21.761144 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:21.761828 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:21.762307 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:21.762725 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:21.900126 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:21.910774 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-7fbd56bf-8d1f-4596-a070-0093c0d17f68 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.161319 Oct 12 12:51:21.911416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 583/1145] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:21 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:22.936955 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:22.937872 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:22.945050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:22.945538 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:22.946096 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:22.946801 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:22.947329 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:22.947753 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:23.098396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:23.105974 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-78baa291-0951-4d26-8a1b-e11ee1c8473d tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.175100 Oct 12 12:51:23.106546 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 563/1146] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:22 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:23.681493 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e97cce9-cf98-4534-8979-2fbb122af629", "name": "network-vif-plugged", "status": "completed", "tag": "6d01a866-f829-4985-911d-955a971f9cce"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:23.690089 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:23.693906 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:23.694422 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:23.694851 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:23.718711 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] Creating event network-vif-plugged:6d01a866-f829-4985-911d-955a971f9cce for instance 8e97cce9-cf98-4534-8979-2fbb122af629 on hv-cinder-81268 Oct 12 12:51:23.731180 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-8204bc7c-aa25-43bb-b6b2-f7ad0712de1d req-7874549f-8c6d-43d7-a989-739df7818024 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055898 Oct 12 12:51:23.731873 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 584/1147] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:24.129229 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:24.130557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:24.132768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:24.138082 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=6 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:24.140084 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:24.140757 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:24.141367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:24.142208 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:24.142580 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:24.142967 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:24.380281 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:24.387234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-97e4120b-5843-4c21-90df-849c8ddc0f1e tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.262243 Oct 12 12:51:24.387951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 564/1148] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:24 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:25.411176 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:25.411867 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:25.419475 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:25.419949 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:25.420381 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:25.421068 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:25.421512 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:25.421927 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:25.555324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:25.562945 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a451780b-9ea3-4a8d-a145-c72280a233ef tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1315 microversion: 2.1 time: 0.155873 Oct 12 12:51:25.563515 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 585/1149] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:25 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:26.585122 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:26.585739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:26.592725 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:26.594136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:26.594136 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:26.594496 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:26.594947 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:26.595364 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:26.724757 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:26.732977 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3c6e38c6-e339-42f8-a30d-b90c1643c477 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1465 microversion: 2.1 time: 0.152069 Oct 12 12:51:26.733544 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 565/1150] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:26 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1465 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:26.779856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:26.779856 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:26.785985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:26.786461 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:26.786883 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:26.787559 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:26.788002 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:26.788419 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:26.813560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Going to try to terminate instance {{(pid=130867) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:51:27.088880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-001a686e-4799-41ef-a14f-80acd44f3413 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "DELETE /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 204 len: 0 microversion: 2.1 time: 0.313317 Oct 12 12:51:27.089462 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 586/1151] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:51:26 2022] DELETE /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:51:27.097609 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:27.098247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:27.104752 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:27.105228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:27.105658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:27.106375 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:27.106824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:27.107246 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:27.234543 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:27.242531 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-6cb1b3e6-7dea-4053-8e28-25805681cd7f tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1471 microversion: 2.1 time: 0.148788 Oct 12 12:51:27.243098 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 566/1152] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:27 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1471 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:28.265427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:28.266160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:28.272589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:28.273069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:28.273507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:28.274228 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:28.274684 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:28.275110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:28.293847 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:28.408444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:28.416846 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-29e9d89e-bb95-4197-b743-438cfbe9b99c tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1471 microversion: 2.1 time: 0.155904 Oct 12 12:51:28.417416 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 587/1153] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:28 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:29.332355 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e97cce9-cf98-4534-8979-2fbb122af629", "name": "network-vif-deleted", "tag": "6d01a866-f829-4985-911d-955a971f9cce"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:29.342405 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:29.342879 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:29.343303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:29.356674 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] Creating event network-vif-deleted:6d01a866-f829-4985-911d-955a971f9cce for instance 8e97cce9-cf98-4534-8979-2fbb122af629 on hv-cinder-81268 Oct 12 12:51:29.361116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-13dcd604-7042-4616-b778-c23728e20d7f req-57bc29b8-d7f8-483e-bb57-bcf4d39e31d7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Oct 12 12:51:29.361725 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 567/1154] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:51:29.439744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:29.440360 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:29.448307 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:29.448792 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:29.449222 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:29.449912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:29.450384 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:29.450806 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:29.512737 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1e915d562a466cacb53942e1198333', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172681aae5d649b7b8cc5dd50779a631', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:51:29.521321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-788d370e-3ad7-4a43-9fba-310252d88561 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 200 len: 1429 microversion: 2.1 time: 0.085518 Oct 12 12:51:29.521983 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 588/1155] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:29 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 1429 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:51:30.545909 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:51:30.546633 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] [instance: 8e97cce9-cf98-4534-8979-2fbb122af629] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:51:30.552768 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:30.553245 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:30.553677 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:30.554396 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:51:30.554851 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:51:30.555273 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:51:30.570832 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.wsgi [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] HTTP exception thrown: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Request method failure captured: Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: request: GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 HTTP/1.1 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept: application/json Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Accept-Encoding: identity Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Connection: close Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Length: 0 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Content-Type: application/json Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Host: 10.222.0.44 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Openstack-System-Scope: None Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: User-Agent: python-urllib3/1.26.12 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Auth-Token: gAAAAABjRrg-OltXBDIJGS2ZgxoJ2G4gH5yQ_7lcPYzA--Sz3f4xouX_fHpfoPh1CyFECqLAJGYkrfy_MC3_TREY-yZPwEx6k6Wyxnxpa0Z70kMSreBCyu_WcrlavmSLPmpwZVWnmCIFa8g-e05TMo0HtC_kpeCMsfKkX4vYKD2vtfyB2lfM8Ig Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Id: None Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Domain-Name: None Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Identity-Status: Confirmed Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Is-Admin-Project: True Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Id: default Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Domain-Name: Default Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Id: 172681aae5d649b7b8cc5dd50779a631 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Project-Name: tempest-VolumesNegativeTest-603959969 Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Role: reader,member Oct 12 12:51:30.573033 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Roles: reader,member Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/172681aae5d649b7b8cc5dd50779a631"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/172681aae5d649b7b8cc5dd50779a631"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/172681aae5d649b7b8cc5dd50779a631"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_172681aae5d649b7b8cc5dd50779a631", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant: tempest-VolumesNegativeTest-603959969 Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Id: 172681aae5d649b7b8cc5dd50779a631 Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-Tenant-Name: tempest-VolumesNegativeTest-603959969 Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User: tempest-VolumesNegativeTest-603959969-project Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Id: default Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Domain-Name: Default Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Id: ed1e915d562a466cacb53942e1198333 Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: X-User-Name: tempest-VolumesNegativeTest-603959969-project Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: method: > Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: exception: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. Oct 12 12:51:30.574645 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: action_args: {'id': '8e97cce9-cf98-4534-8979-2fbb122af629'} Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:51:30.575767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. Oct 12 12:51:30.577042 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: ERROR nova.api.openstack.wsgi Oct 12 12:51:30.578238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] Returning 404 to user: Instance 8e97cce9-cf98-4534-8979-2fbb122af629 could not be found. {{(pid=130866) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:51:30.578238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4c208b08-3ede-4a1a-9781-40325d6b9b69 tempest-VolumesNegativeTest-603959969 tempest-VolumesNegativeTest-603959969-project] 10.222.0.44 "GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629" status: 404 len: 111 microversion: 2.1 time: 0.033287 Oct 12 12:51:30.578238 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 568/1156] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:51:30 2022] GET /compute/v2.1/servers/8e97cce9-cf98-4534-8979-2fbb122af629 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:51:59.659704 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-98b5cc01-b560-4a27-9df4-90755d47e34a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'create', calling method: .version_select at 0x7f98054cb8b0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1433963557", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKVyUN5Axn0CRoXqxOCILWka12giezN3rCHHt3Amu5lcImCsBLRgK6TscOWuGkXhZyOMUCBbhXr9+TmrDLDmJwd378AeKziBVaUYvxhLRbJTjLNYx1jhy2qC1HDBsgDYpA=="}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:59.665314 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:59.665981 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=8 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:59.678128 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-98b5cc01-b560-4a27-9df4-90755d47e34a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Getting quotas for project 7bc9dba7cc864f998bc613e10cf3b4aa. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:51:59.680525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.quota [None req-98b5cc01-b560-4a27-9df4-90755d47e34a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Getting quotas for user 73179467b36a48a1b1c693dc9c026c9e and project 7bc9dba7cc864f998bc613e10cf3b4aa. Resources: {'key_pairs'} {{(pid=130867) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:51:59.837796 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-98b5cc01-b560-4a27-9df4-90755d47e34a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.181710 Oct 12 12:51:59.838731 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 589/1157] 10.222.0.44 () {60 vars in 1159 bytes} [Wed Oct 12 12:51:59 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:51:59.889207 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1714927245", "imageRef": "8bb7b4f1-e972-479a-ab73-a6498e9bf36b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1433963557", "networks": [{"uuid": "78b8637a-5577-477b-80f6-53a374c5d245"}]}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:51:59.897835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:59.898497 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:51:59.941949 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.network.neutron [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] validate_networks() for [('78b8637a-5577-477b-80f6-53a374c5d245', None, None, None, None, None)] {{(pid=130866) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Oct 12 12:52:00.409534 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Flavor limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Oct 12 12:52:00.409993 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Image limits 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Oct 12 12:52:00.410474 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Flavor pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Oct 12 12:52:00.410887 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Image pref 0:0:0 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Oct 12 12:52:00.411297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.virt.hardware [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=130866) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Oct 12 12:52:00.419900 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:00.420386 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:00.420824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:00.421558 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:00.422045 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:00.422472 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:00.439360 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Getting quotas for project 7bc9dba7cc864f998bc613e10cf3b4aa. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:393}} Oct 12 12:52:00.443381 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.quota [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Getting quotas for user 73179467b36a48a1b1c693dc9c026c9e and project 7bc9dba7cc864f998bc613e10cf3b4aa. Resources: {'instances', 'cores', 'ram'} {{(pid=130866) _get_quotas /opt/stack/nova/nova/quota.py:383}} Oct 12 12:52:00.454997 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Going to run 1 instances... {{(pid=130866) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Oct 12 12:52:00.457204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8bb7b4f1-e972-479a-ab73-a6498e9bf36b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=130866) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Oct 12 12:52:00.589541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-a7fa6f1e-3159-48f2-9117-8998279caa34 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.704828 Oct 12 12:52:00.590228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 569/1158] 10.222.0.44 () {60 vars in 1147 bytes} [Wed Oct 12 12:51:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Oct 12 12:52:00.601959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-bdfddb4d-c940-4908-a122-f7068c56f84f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:00.604197 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-bdfddb4d-c940-4908-a122-f7068c56f84f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:00.658278 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-bdfddb4d-c940-4908-a122-f7068c56f84f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:00.665052 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-bdfddb4d-c940-4908-a122-f7068c56f84f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1259 microversion: 2.1 time: 0.067674 Oct 12 12:52:00.666154 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 590/1159] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:00 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1259 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:01.688649 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7591045c-9214-4e85-8321-1ac37a371808 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:01.689202 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7591045c-9214-4e85-8321-1ac37a371808 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:01.741443 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7591045c-9214-4e85-8321-1ac37a371808 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:01.748455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7591045c-9214-4e85-8321-1ac37a371808 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1259 microversion: 2.1 time: 0.064203 Oct 12 12:52:01.749022 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 570/1160] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:01 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1259 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:02.771007 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:02.771652 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:02.779636 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:02.780121 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:02.780555 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:02.781249 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:02.781701 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:02.782178 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:02.846609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:02.854250 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b809e150-41d8-4d29-9f15-6ee6865c2e8c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1311 microversion: 2.1 time: 0.087069 Oct 12 12:52:02.854818 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 591/1161] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:02 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1311 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:52:03.876814 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:03.877429 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:03.884819 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:03.885299 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:03.886302 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:03.886995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:03.887451 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:03.887876 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:03.950789 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:03.958408 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ab4438ca-bdeb-4268-89d9-14570eacc851 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1317 microversion: 2.1 time: 0.085416 Oct 12 12:52:03.958969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 571/1162] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:03 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1317 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:04.983974 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:04.984548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:04.990950 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:04.991430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:04.991858 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:04.992748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:04.993193 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:04.993609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:05.139529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:05.147743 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-207f67e1-438a-4be0-8774-985cc254e207 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.168155 Oct 12 12:52:05.148339 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 592/1163] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:04 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:52:06.171729 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:06.172376 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:06.179002 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:06.179491 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:06.179926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:06.180626 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:06.181127 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:06.181557 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:06.313234 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:06.321021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9ed1d0b8-3259-4895-b838-c00e5505cb3d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.153169 Oct 12 12:52:06.321596 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 572/1164] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:06 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:07.343558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:07.344113 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:07.350777 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:07.351257 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:07.351710 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:07.352912 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:07.353380 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:07.353800 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:07.499309 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:07.507593 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-71646ef3-d5d5-4ef5-80fe-f725da0f2534 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.167869 Oct 12 12:52:07.508172 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 593/1165] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:07 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:08.530366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:08.530964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:08.537703 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:08.538179 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:08.538613 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:08.539312 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:08.539824 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:08.540252 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:08.675279 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:08.683774 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-4f2151d2-62c2-4210-9c4f-fafc1d40483b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.157143 Oct 12 12:52:08.684258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 573/1166] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:08 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:09.706115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:09.706832 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:09.714041 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:09.714525 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:09.714953 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:09.715642 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:09.716091 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:09.716509 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:09.850079 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:09.858227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-1f728b9a-9ad6-4fc1-ae0b-5645c93d724a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.155861 Oct 12 12:52:09.860050 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 594/1167] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:09 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:11.077871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:11.077871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:11.077871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:11.077871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:11.077871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:11.079941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:11.079941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:11.079941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:11.079941 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:11.080636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:11.080636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-1b165d08-99d4-42e4-a12b-a652d0301911 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.162414 Oct 12 12:52:11.080636 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 574/1168] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:10 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:11.881571 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:11.886621 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell0:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:11.892378 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:11.896486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:11.896486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:11.904053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] Creating event network-changed:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:52:11.909155 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-bfd922fa-8852-4571-86f8-b7f78718a7a2 req-bdda3020-4e82-4b23-b013-0e35564714b7 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031245 Oct 12 12:52:11.909978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 595/1169] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:12.094777 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:12.095418 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:12.097345 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=8 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:12.103366 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:12.107193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:12.107193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:12.107193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:12.107193 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:12.107576 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:12.236871 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:12.244745 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f0dc9ce8-e43f-4d14-a7a8-c8ac91e7a85d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.154820 Oct 12 12:52:12.245394 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 575/1170] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:12 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:13.269320 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:13.270083 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:13.276848 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:13.277321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:13.277753 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:13.278464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:13.278922 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:13.279345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:13.403386 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:13.410959 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-b4795d1a-5b9c-47bc-a64d-12f0d5bd3691 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.146818 Oct 12 12:52:13.411544 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 596/1171] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:13 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:14.433499 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:14.434148 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:14.440669 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:14.441147 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:14.441611 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:14.442383 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:14.442840 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:14.443265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:14.573289 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:14.580913 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ddde1de4-41e2-4e4c-9fa8-c428d949c989 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.151242 Oct 12 12:52:14.581473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 576/1172] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:14 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:15.604433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:15.605043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:15.611379 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:15.611850 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:15.612281 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:15.612958 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:15.613404 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:15.613822 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:15.737924 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:15.745748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-511d42ca-3b63-4266-a06f-f62458e527e9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.145283 Oct 12 12:52:15.746356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 597/1173] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:15 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:16.769249 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:16.769991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:16.776994 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:16.777476 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:16.777965 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:16.778664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:16.779118 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:16.779542 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:16.910130 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:16.917870 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-65fed39d-50de-4a45-98be-dd668494fc65 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.152570 Oct 12 12:52:16.918461 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 577/1174] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:16 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:17.910376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "name": "network-vif-plugged", "status": "completed", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:17.920631 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:17.921133 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:17.921560 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:17.935110 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] Creating event network-vif-plugged:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:52:17.940124 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-f4977ea4-6924-4082-81eb-c00f7dfcb845 req-ab8e423d-f201-4d53-b770-db4d3661c630 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033388 Oct 12 12:52:17.940649 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 598/1175] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:52:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:17.941614 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:17.942410 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:17.949116 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:17.949588 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:17.950244 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:17.950931 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:17.951473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:17.951895 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:18.080441 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:18.088683 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-5402c39a-41ef-4fa1-b80d-66619237ed4f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.151820 Oct 12 12:52:18.089248 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 578/1176] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:17 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:52:19.112729 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:19.113451 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:19.120141 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:19.120614 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:19.121043 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:19.121724 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:19.122209 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:19.122630 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:19.246528 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:19.254160 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-17671bf2-fdb6-4f17-b602-89e238e6c8d5 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1359 microversion: 2.1 time: 0.146114 Oct 12 12:52:19.254722 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 599/1177] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:19 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1359 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:20.276406 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:20.277019 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:20.283675 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.284172 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.284583 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.285309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.285759 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.286211 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.415080 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:20.422742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-9ef12a95-d387-4b26-b83e-85a12779c7a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1549 microversion: 2.1 time: 0.150307 Oct 12 12:52:20.423310 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 579/1178] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:20 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1549 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:20.446881 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:20.447565 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:20.453913 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.454428 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.454952 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.455627 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.456078 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.456497 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.583623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:20.591645 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cc6bcdb9-177e-4f32-8f26-27a116ab561b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1549 microversion: 2.1 time: 0.148604 Oct 12 12:52:20.592218 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 600/1179] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:20 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1549 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:20.613419 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:20.618847 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:20.619616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Searching by: {'deleted': False, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa'} {{(pid=130866) get_all /opt/stack/nova/nova/compute/api.py:3017}} Oct 12 12:52:20.626143 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.626624 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.627061 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.627788 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.628242 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.628670 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.718322 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.multi_cell_list [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=130866) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Oct 12 12:52:20.816297 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f4f2ef3c-6931-4bd9-ab80-51765073f9aa tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.206535 Oct 12 12:52:20.816906 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 580/1180] 10.222.0.44 () {58 vars in 1125 bytes} [Wed Oct 12 12:52:20 2022] GET /compute/v2.1/servers => generated 343 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:20.828323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:20.828939 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:20.840931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.840931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.840931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.840931 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:20.841356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:20.841356 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:20.962034 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:20.970165 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-ca2f733e-3156-43de-aa26-8ace744c49d9 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1549 microversion: 2.1 time: 0.145554 Oct 12 12:52:20.970741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 601/1181] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:20 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1549 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:22.976425 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "65d02f32-ad2c-4bf4-a165-53609b1301b2"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:22.978815 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:22.985243 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:22.985723 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:22.986192 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:22.986880 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:22.987330 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:22.987750 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:23.873232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-f3c2a7f6-748e-4b2e-8e4c-483baf2ee124 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.901001 Oct 12 12:52:23.873992 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 581/1182] 10.222.0.44 () {60 vars in 1323 bytes} [Wed Oct 12 12:52:22 2022] POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments => generated 194 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:31.453142 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:31.453745 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:31.456499 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:31.457153 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=58 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:31.462168 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:31.462640 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:31.463069 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:31.463744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:31.464188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:31.464609 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:31.595082 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:31.603232 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-42013c66-563d-443e-9863-037e8baf1773 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1595 microversion: 2.1 time: 0.154154 Oct 12 12:52:31.603795 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 602/1183] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:31 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1595 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:33.467323 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:33.476601 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell0:SELECT=2 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:33.477691 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:33.480367 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:33.480799 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:33.481298 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:33.485473 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:33.492737 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] Creating event network-changed:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:52:33.497863 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-bc2f96b0-2edb-4807-b948-f33c1f38b61f req-9c289a5d-513a-400f-b42e-2a6aa578287a service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034734 Oct 12 12:52:33.498587 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 582/1184] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:35.828917 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1691795859"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:35.829436 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:35.836248 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:35.836734 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:35.837167 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:35.837854 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:35.838328 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:35.838748 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:35.963004 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.network.security_group_api [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Adding security group ca3dc03a-a7b7-4457-853b-ee89e5b063f6 to port 97b839e5-ff1e-4dc0-94ce-b81e679d1f6e Oct 12 12:52:36.338791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-f6213bcd-4b02-40ec-a4a9-328aeebac51d tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action" status: 202 len: 0 microversion: 2.1 time: 0.513802 Oct 12 12:52:36.339411 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 603/1185] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:52:35 2022] POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action => generated 0 bytes in 515 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:52:36.349584 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:36.350336 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:36.350994 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:36.358725 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:36.359218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:36.360117 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:36.360350 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:36.360839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:36.361259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:36.368968 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:36.369706 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:36.370323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:36.383673 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] Creating event network-changed:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:52:36.389486 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-3ebcdd3c-2be8-4133-9024-d626ae091acb req-b60a783b-e0ec-4051-9e28-99a81c6ed794 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042474 Oct 12 12:52:36.390700 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 604/1186] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:52:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:52:36.521095 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:36.531898 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-0a987115-a8c6-4ab4-81df-45ec25d54bdc tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1761 microversion: 2.1 time: 0.187775 Oct 12 12:52:36.532484 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 583/1187] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:36 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1761 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:52.478383 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:52:52.480691 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:52.483343 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:52:52.483485 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Wed Oct 12 12:52:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action (ip 10.222.0.44) !!! Oct 12 12:52:52.486064 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=6 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:52.486730 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=12 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:52.497243 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:52.507871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:52.507871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:52.507871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:52.507871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:52.508352 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:52.772880 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-2a06bb70-43fd-4181-85e7-80ce020cf607 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action" status: 202 len: 0 microversion: 2.1 time: 0.298572 Oct 12 12:52:52.773425 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 605/1188] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:52:52 2022] POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Oct 12 12:52:52.782064 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:52.782964 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:52.785383 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Oct 12 12:52:52.785524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: Wed Oct 12 12:52:52 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 (ip 10.222.0.44) !!! Oct 12 12:52:52.787060 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=4 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:52.787458 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=7 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:52:52.793034 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:52.793513 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:52.793969 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:52.794742 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:52.795201 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:52.795613 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:52.937658 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:52.945891 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-e2200fc5-cc23-4c47-ac07-15eaee145b3b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1753 microversion: 2.1 time: 0.168145 Oct 12 12:52:52.946475 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 584/1189] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:52 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:53.970665 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:53.971285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:53.977433 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:53.977995 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:53.978435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:53.979119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:53.979568 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:53.979989 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:54.124262 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:54.133054 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-c30e366e-a95c-481c-bfec-9aa0069e2b2a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.167262 Oct 12 12:52:54.133623 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 606/1190] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:53 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:55.156294 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:55.156903 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:55.162935 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:55.163411 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:55.163859 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:55.164516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:55.164961 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:55.165377 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:55.305075 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:55.313836 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-7c3d47a8-40ec-412f-81e4-3db121be5195 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.161392 Oct 12 12:52:55.314445 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 585/1191] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:55 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:56.337909 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:56.338538 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:56.345770 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:56.346334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:56.346765 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:56.347444 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:56.347888 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:56.348303 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:56.487622 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:56.495754 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-6e9842f9-6cd8-4e38-aae0-b004be830c97 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.161842 Oct 12 12:52:56.496324 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 607/1192] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:56 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:57.519340 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:57.519943 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:57.526258 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:57.526733 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:57.527161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:57.527844 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:57.528287 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:57.528700 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:57.667259 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:57.675995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-89a08cb9-7b9a-448c-83f5-f8cc07bab65e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.161013 Oct 12 12:52:57.679951 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 586/1193] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:57 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:58.699553 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:58.700464 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:58.706768 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:58.707247 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:58.707675 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:58.708351 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:58.708797 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:58.709211 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:58.845601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:52:58.853736 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-cdfc1688-f2ee-4e71-8c3c-014d5c50bc6b tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.158014 Oct 12 12:52:58.854335 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 608/1194] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:58 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:52:59.878309 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:52:59.878926 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:52:59.885209 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:59.885687 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:59.886156 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:52:59.886835 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:52:59.887282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:52:59.887701 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:00.026282 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:00.034426 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-59f45621-689c-4c28-94a7-2f1a21755826 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.160104 Oct 12 12:53:00.034991 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 587/1195] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:52:59 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:01.057978 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:01.058601 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:01.065553 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:01.067591 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:01.068048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:01.068791 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:01.069256 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:01.069680 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:01.212507 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:01.220717 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-9f683d75-227a-418c-9a3e-14351ccff420 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.166637 Oct 12 12:53:01.221340 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 609/1196] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:01 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:02.243689 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:02.244303 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:02.250638 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:02.251117 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:02.251549 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:02.252247 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:02.252673 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:02.253094 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:02.388713 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:02.396765 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ed3ffd0c-3d60-410d-bb8f-0796f56cc145 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.156979 Oct 12 12:53:02.397326 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 588/1197] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:02 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:03.420971 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:03.421520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:03.428065 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:03.428551 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:03.428985 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:03.429678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:03.430164 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:03.430589 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:03.567370 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:03.576200 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e6719737-2b0a-40e1-9ad5-65f2685353ff tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.159828 Oct 12 12:53:03.576771 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 610/1198] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:03 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:04.599565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:04.600177 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:04.607290 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:04.607767 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:04.608195 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:04.608872 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:04.609320 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:04.609739 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:04.853168 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:04.862113 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-ccd8dd6e-9f5a-494e-9496-b06aece4fad4 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1758 microversion: 2.1 time: 0.266355 Oct 12 12:53:04.862712 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 589/1199] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:04 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1758 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:05.884744 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:05.885358 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:05.891782 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:05.892206 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:05.892639 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:05.893321 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:05.893773 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:05.894223 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:06.082313 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:06.090494 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e0a26230-f5ad-4de6-99d2-2e6371a4649c tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1761 microversion: 2.1 time: 0.209605 Oct 12 12:53:06.091057 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 611/1200] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:05 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1761 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:38.405050 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1691795859"}} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:53:38.405598 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:38.407640 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_api:SELECT=12 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:38.408413 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG dbcounter [-] [130866] Writing DB stats nova_cell1:SELECT=36 {{(pid=130866) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:38.413516 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:38.414017 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:38.414452 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:38.415133 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:38.415581 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:38.415999 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:38.542397 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.network.security_group_api [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Removing security group ca3dc03a-a7b7-4457-853b-ee89e5b063f6 from port 97b839e5-ff1e-4dc0-94ce-b81e679d1f6e Oct 12 12:53:38.875995 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-91dac62f-c844-4de0-bb07-ae84897f6831 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action" status: 202 len: 0 microversion: 2.1 time: 0.474420 Oct 12 12:53:38.876272 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 590/1201] 10.222.0.44 () {60 vars in 1278 bytes} [Wed Oct 12 12:53:38 2022] POST /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/action => generated 0 bytes in 476 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:53:38.884210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:53:38.890891 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_api:SELECT=14 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:38.891920 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG dbcounter [-] [130867] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=130867) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Oct 12 12:53:38.897427 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:38.898476 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:38.899184 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:38.912345 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] Creating event network-changed:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:53:38.918210 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-c67c5d9c-ea1b-4ef7-9d39-0d773fb5982a req-8591dbed-8bee-405b-88cd-4e7ba5432461 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038256 Oct 12 12:53:38.919119 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 612/1202] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:53:40.062091 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:40.062614 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:40.069656 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:40.070249 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:40.071214 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:40.071524 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:40.072047 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:40.072565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:40.154775 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.objects.instance [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lazy-loading 'services' on Instance uuid 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 {{(pid=130866) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Oct 12 12:53:40.350212 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-01c52083-f516-4cea-a3c3-a02bbda4b474 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments/65d02f32-ad2c-4bf4-a165-53609b1301b2" status: 202 len: 0 microversion: 2.1 time: 0.291844 Oct 12 12:53:40.352455 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 591/1203] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:53:40 2022] DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments/65d02f32-ad2c-4bf4-a165-53609b1301b2 => generated 0 bytes in 294 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Oct 12 12:53:40.360430 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:40.363295 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:40.372053 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:40.372532 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:40.372957 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:40.373646 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:40.374137 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:40.374558 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:40.406438 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-a12f2e43-60a7-419b-af3d-14c5d21eeab3 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050304 Oct 12 12:53:40.407294 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 613/1204] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:53:40 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:53:40.934639 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:53:40.947063 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:40.947505 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:40.947862 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:40.960180 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.compute.server_external_events [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] Creating event network-changed:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:53:40.965232 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [req-6065ff28-5976-450d-866e-13d74d6b59a4 req-50171327-6fbf-406f-b17b-c713b3d8ff5e service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035051 Oct 12 12:53:40.967272 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 592/1205] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:53:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:53:41.420362 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:41.422529 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:41.429277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:41.430672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:41.430672 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:41.430904 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:41.431434 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:41.431715 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:41.461467 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-15559858-98ac-458a-8db3-73f0e116bc51 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045385 Oct 12 12:53:41.462048 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 614/1206] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:53:41 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Oct 12 12:53:42.475204 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:42.477398 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:42.483962 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:42.484436 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:42.484864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:42.485541 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:42.486010 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:42.486431 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:42.514231 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-8c844549-123e-4bc4-8d97-2bfe778fecde tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044010 Oct 12 12:53:42.514776 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 593/1207] 10.222.0.44 () {58 vars in 1302 bytes} [Wed Oct 12 12:53:42 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Oct 12 12:53:42.526180 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:42.526678 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:42.532977 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:42.533445 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:42.533871 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:42.534572 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:42.535017 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:42.535435 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:42.607333 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] HTTP exception thrown: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 is not attached to volume 65d02f32-ad2c-4bf4-a165-53609b1301b2 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Request method failure captured: Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments/65d02f32-ad2c-4bf4-a165-53609b1301b2 HTTP/1.1 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrheCymQl2kgB2chLQGolGGrI52Ve6Bk5dwnhzgiAg5VSu_nEs4YsP5thZZcXtDzVQ5A_88iMo08tciYq9QcXU3-qO6uKRn0CNCZl1FtHxSw1g8US94lNOClvm1WrBRnjGoxwtTTy_tUYpnVwPssdDe4PZua-vfD18BN2e_t42mr6A4 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 7bc9dba7cc864f998bc613e10cf3b4aa Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:53:42.609688 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7bc9dba7cc864f998bc613e10cf3b4aa", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 7bc9dba7cc864f998bc613e10cf3b4aa Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-TestMinimumBasicScenario-255863065-project Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 73179467b36a48a1b1c693dc9c026c9e Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-TestMinimumBasicScenario-255863065-project Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:53:42.611520 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 is not attached to volume 65d02f32-ad2c-4bf4-a165-53609b1301b2 Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'server_id': '1502e9a1-eec1-42e4-8f64-016fe6ab9da4', 'id': '65d02f32-ad2c-4bf4-a165-53609b1301b2'} Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 65d02f32-ad2c-4bf4-a165-53609b1301b2. Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:53:42.612660 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 is not attached to volume 65d02f32-ad2c-4bf4-a165-53609b1301b2 Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 is not attached to volume 65d02f32-ad2c-4bf4-a165-53609b1301b2 Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:42.614334 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Returning 404 to user: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 is not attached to volume 65d02f32-ad2c-4bf4-a165-53609b1301b2 {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:53:42.615941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-e1c9de31-c422-42a5-9c98-7952cc3a8f76 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments/65d02f32-ad2c-4bf4-a165-53609b1301b2" status: 404 len: 154 microversion: 2.1 time: 0.089253 Oct 12 12:53:42.615941 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 615/1208] 10.222.0.44 () {58 vars in 1416 bytes} [Wed Oct 12 12:53:42 2022] DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4/os-volume_attachments/65d02f32-ad2c-4bf4-a165-53609b1301b2 => generated 154 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:43.886839 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:43.887332 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:43.893616 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:43.894135 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:43.894565 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:43.895296 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:43.895743 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:43.896157 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:43.919778 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Going to try to terminate instance {{(pid=130866) delete /opt/stack/nova/nova/compute/api.py:2719}} Oct 12 12:53:44.205798 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-044dd423-6d19-42f0-927a-8a0201f6061e tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 204 len: 0 microversion: 2.1 time: 0.322494 Oct 12 12:53:44.206422 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 594/1209] 10.222.0.44 () {58 vars in 1239 bytes} [Wed Oct 12 12:53:43 2022] DELETE /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Oct 12 12:53:44.214613 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:44.215227 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:44.221596 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:44.222115 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:44.222548 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:44.223231 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:44.224188 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:44.224607 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:44.352062 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.policy [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130867) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:44.359721 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-5190dabc-7983-4296-b075-1101085b06a2 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1555 microversion: 2.1 time: 0.148999 Oct 12 12:53:44.360277 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 616/1210] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:44 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1555 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:45.382532 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:45.383161 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:45.389716 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:45.390218 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:45.390653 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:45.391352 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:45.391805 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:45.392228 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:45.520769 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:45.529021 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-84a9bba1-4dec-4e6e-a77f-742995423f8a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1555 microversion: 2.1 time: 0.150918 Oct 12 12:53:45.529590 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 595/1211] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:45 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Oct 12 12:53:46.524429 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1502e9a1-eec1-42e4-8f64-016fe6ab9da4", "name": "network-vif-deleted", "tag": "97b839e5-ff1e-4dc0-94ce-b81e679d1f6e"}]} {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Oct 12 12:53:46.534323 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:46.535359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:46.535359 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:46.546285 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.compute.server_external_events [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] Creating event network-vif-deleted:97b839e5-ff1e-4dc0-94ce-b81e679d1f6e for instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 on hv-cinder-81268 Oct 12 12:53:46.551741 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [req-4c2a10a2-65a3-4677-9fd5-edf802c7d814 req-c6fd7233-be5c-4fe6-bbfb-bd7fb2ad0a31 service nova] 10.222.0.44 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031624 Oct 12 12:53:46.552016 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:46.553043 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.compute.api [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130866) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:46.553304 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 617/1212] 10.222.0.44 () {64 vars in 1317 bytes} [Wed Oct 12 12:53:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Oct 12 12:53:46.559786 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:46.560265 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:46.563664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:46.563664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:46.563664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:46.563664 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG oslo_concurrency.lockutils [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=130866) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:46.623595 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.policy [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '73179467b36a48a1b1c693dc9c026c9e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7bc9dba7cc864f998bc613e10cf3b4aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=130866) authorize /opt/stack/nova/nova/policy.py:199}} Oct 12 12:53:46.633012 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-3ae22087-1097-4845-a4cb-0d9b162f062a tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 200 len: 1513 microversion: 2.1 time: 0.084974 Oct 12 12:53:46.633641 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 596/1213] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:46 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 1513 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Oct 12 12:53:47.657318 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '>' {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:47.657925 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.compute.api [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] [instance: 1502e9a1-eec1-42e4-8f64-016fe6ab9da4] Fetching instance by UUID {{(pid=130867) get /opt/stack/nova/nova/compute/api.py:2975}} Oct 12 12:53:47.665327 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:47.665840 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:47.666299 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:47.667031 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Acquiring lock "5ad657cf-e300-4750-943b-1f19054f5990" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Oct 12 12:53:47.667483 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Oct 12 12:53:47.667916 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG oslo_concurrency.lockutils [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Lock "5ad657cf-e300-4750-943b-1f19054f5990" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=130867) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Oct 12 12:53:47.681761 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.wsgi [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] HTTP exception thrown: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Request method failure captured: Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: request: GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 HTTP/1.1 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept: application/json Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Accept-Encoding: identity Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Connection: close Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Length: 0 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Content-Type: application/json Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Host: 10.222.0.44 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: Openstack-System-Scope: None Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: User-Agent: python-urllib3/1.26.12 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Auth-Token: gAAAAABjRrheCymQl2kgB2chLQGolGGrI52Ve6Bk5dwnhzgiAg5VSu_nEs4YsP5thZZcXtDzVQ5A_88iMo08tciYq9QcXU3-qO6uKRn0CNCZl1FtHxSw1g8US94lNOClvm1WrBRnjGoxwtTTy_tUYpnVwPssdDe4PZua-vfD18BN2e_t42mr6A4 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Id: None Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Domain-Name: None Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Identity-Status: Confirmed Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Is-Admin-Project: True Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Id: default Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Domain-Name: Default Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Id: 7bc9dba7cc864f998bc613e10cf3b4aa Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Project-Name: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Role: reader,member Oct 12 12:53:47.683376 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Roles: reader,member Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Service-Catalog: [{"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/identity"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/compute/v2/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/volume/v3/7bc9dba7cc864f998bc613e10cf3b4aa"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:8080/v1/AUTH_7bc9dba7cc864f998bc613e10cf3b4aa", "adminURL": "http://10.222.0.44:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.44:9696/networking"}]}] Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Id: 7bc9dba7cc864f998bc613e10cf3b4aa Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-Tenant-Name: tempest-TestMinimumBasicScenario-255863065 Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User: tempest-TestMinimumBasicScenario-255863065-project Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Id: default Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Domain-Name: Default Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Id: 73179467b36a48a1b1c693dc9c026c9e Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: X-User-Name: tempest-TestMinimumBasicScenario-255863065-project Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: method: > Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: exception: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. Oct 12 12:53:47.685086 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: action_args: {'id': '1502e9a1-eec1-42e4-8f64-016fe6ab9da4'} Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: {{(pid=130867) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Oct 12 12:53:47.686120 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = self._get_server( Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. Oct 12 12:53:47.687967 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: ERROR nova.api.openstack.wsgi Oct 12 12:53:47.689470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: DEBUG nova.api.openstack.wsgi [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Returning 404 to user: Instance 1502e9a1-eec1-42e4-8f64-016fe6ab9da4 could not be found. {{(pid=130867) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Oct 12 12:53:47.689470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: INFO nova.api.openstack.requestlog [None req-94a49f04-d01a-42df-ba86-7ff501281d04 tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4" status: 404 len: 111 microversion: 2.1 time: 0.031859 Oct 12 12:53:47.689470 dv-cinder-812685-16-iscsi devstack@n-api.service[130867]: [pid: 130867|app: 0|req: 618/1214] 10.222.0.44 () {58 vars in 1236 bytes} [Wed Oct 12 12:53:47 2022] GET /compute/v2.1/servers/1502e9a1-eec1-42e4-8f64-016fe6ab9da4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Oct 12 12:53:47.693665 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: DEBUG nova.api.openstack.wsgi [None req-c548b676-9ee8-44fe-8c81-67bee5c3605f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] Calling method '.version_select at 0x7f9805499430>' {{(pid=130866) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Oct 12 12:53:47.770255 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: INFO nova.api.openstack.requestlog [None req-c548b676-9ee8-44fe-8c81-67bee5c3605f tempest-TestMinimumBasicScenario-255863065 tempest-TestMinimumBasicScenario-255863065-project] 10.222.0.44 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1433963557" status: 202 len: 0 microversion: 2.1 time: 0.080192 Oct 12 12:53:47.770864 dv-cinder-812685-16-iscsi devstack@n-api.service[130866]: [pid: 130866|app: 0|req: 597/1215] 10.222.0.44 () {58 vars in 1272 bytes} [Wed Oct 12 12:53:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1433963557 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)